-- Logs begin at Fri 2022-09-30 08:51:28 UTC, end at Fri 2022-09-30 10:55:17 UTC. -- Sep 30 09:21:11.235036 dv-neutron-master-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Sep 30 09:21:11.243953 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 30 09:21:11 2022] *** Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: nodename: dv-neutron-master-2-hyperv Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: machine: x86_64 Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: clock source: unix Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: pcre jit disabled Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: detected number of CPU cores: 4 Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: current working directory: / Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: detected binary path: /usr/bin/uwsgi-core Sep 30 09:21:11.246069 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: your processes number limit is 47680 Sep 30 09:21:11.246649 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: your memory page size is 4096 bytes Sep 30 09:21:11.246649 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: detected max file descriptor number: 2048 Sep 30 09:21:11.246649 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: lock engine: pthread robust mutexes Sep 30 09:21:11.246649 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: thunder lock: enabled Sep 30 09:21:11.246649 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 30 09:21:11.246649 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 30 09:21:11.286251 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: Python main interpreter initialized at 0x55a861fdc9c0 Sep 30 09:21:11.286251 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: python threads support enabled Sep 30 09:21:11.286251 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: your server socket listen backlog is limited to 100 connections Sep 30 09:21:11.286251 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: your mercy for graceful operations on workers is 90 seconds Sep 30 09:21:11.286649 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: mapped 403077 bytes (393 KB) for 2 cores Sep 30 09:21:11.286730 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: *** Operational MODE: preforking *** Sep 30 09:21:11.286980 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: *** uWSGI is running in multiple interpreter mode *** Sep 30 09:21:11.286980 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: spawned uWSGI master process (pid: 81719) Sep 30 09:21:11.287204 dv-neutron-master-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Sep 30 09:21:11.289225 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: spawned uWSGI worker 1 (pid: 81731, cores: 1) Sep 30 09:21:11.289225 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: spawned uWSGI worker 2 (pid: 81732, cores: 1) Sep 30 09:21:11.289225 dv-neutron-master-2-hyperv devstack@keystone.service[81719]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 30 09:21:15.564630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:21:15.564630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: from cryptography.utils import int_from_bytes Sep 30 09:21:15.565639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:21:15.565639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: from cryptography.utils import int_from_bytes Sep 30 09:21:15.570531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:21:15.570531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: from cryptography.utils import int_from_bytes Sep 30 09:21:15.571039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:21:15.571039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: from cryptography.utils import int_from_bytes Sep 30 09:21:15.615115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 09:21:15.615309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 09:21:15.615473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] command line args: [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 09:21:15.615740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 09:21:15.615940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ================================================================================ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 09:21:15.616168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] admin_token = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.616381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] config_dir = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.616560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.616768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] config_source = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.616891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] debug = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.617122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.617443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.617625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.617714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 09:21:15.617898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.617993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 09:21:15.618134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] command line args: [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 09:21:15.618224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.618358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.618442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 09:21:15.618509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] log_config_append = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.619924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ================================================================================ {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 09:21:15.620121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.620348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] admin_token = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.620544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] log_dir = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.620544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] log_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.620901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] config_dir = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.620901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.621248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.621958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] config_source = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] debug = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.622970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] list_limit = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] log_config_append = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.623818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] log_dir = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] log_file = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.624928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] publish_errors = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625592 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.625971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] standard_threads = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] use_journal = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.626812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] use_json = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] use_stderr = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] publish_errors = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] use_syslog = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.627675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.627889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.627965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.627965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.628092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.628162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.628243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] standard_threads = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.628317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.628393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.628464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.628534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.628603 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.628679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.628679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] use_journal = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.628812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.628881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] use_json = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.628951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] use_stderr = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.629020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] use_syslog = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.629221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:21:15.629397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.629987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.630991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.631906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.632972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.633912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.634945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.635908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.636802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.637945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.638974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.639920 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.640919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.641924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.642898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643295 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.643828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.644940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.645985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.646906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.647946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.648929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.649892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.external = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.650939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.password = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.token = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.651943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.652102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.652178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.652345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.652423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.652599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.652806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.652912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] auth.external = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.653829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] auth.password = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] auth.token = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.654950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.655952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] credential.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.656999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.657106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.657202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.657331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.657515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.657627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.657782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.658047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.658219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.658345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.658493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.658611 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.658773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.658904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.659935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.660985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.661995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.662942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.663011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.663167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.663248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.663764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.663834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.663998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.664947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.665982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.666902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.667850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.668922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.669946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.670986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.671114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.671248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.671375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.671501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.671637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.671763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.671889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.672911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.673094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.673578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.673705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.673879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.673879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.674131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.674259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.674384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.674509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.674636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.674768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.674893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.675908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.676912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.677968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678090 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.678971 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.679967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.680977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.681099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.681222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.681343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.681464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.681591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.681719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.681889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.682895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.683943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] role.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] role.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.684887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.685953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] role.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] role.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.686932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.687911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.688981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.689111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.689234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.689411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.689533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.689654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.689785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.689972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.690107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.690237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.690374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.690509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.690634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.690758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.690885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.691891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692408 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.692915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.693951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.694936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695191 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.695951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.696942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.697953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.698961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.connection = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.699963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.700967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 09:21:15.701323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.701323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.702138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.702138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.702138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:21:15.702138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 09:21:15.730100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.730417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.730599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.730682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.730805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.730805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.739099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.739292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.767226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.767408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.767783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.767783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.820676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.821587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.868731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.868910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.870343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:15.870575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.027523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.027842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.027981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.028146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.028337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.028579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.028711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.028910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.029127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.029341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.029537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.029765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.051895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.052951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.053075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.053153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.053217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.053333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.053422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.064401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.065680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.077924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.078052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.078142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.078295 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.078419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.078556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.078722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81731) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:21:16.095151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.095356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:21:16.095478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.095614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:21:16.095693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.095877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:21:16.095999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.096135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:21:16.096215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.096387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.096522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.096657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.096736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.096856 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.096973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.097095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.106363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.106562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.106686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.106860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.106997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.107100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.107228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.107307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.114073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.114311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.116919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.117133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.117258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.117455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.117620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.117709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.117822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.118906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.119042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.119137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.119304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.119428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.119562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.119643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.119855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.142054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.142179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.143504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.143629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.143756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.143859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.148370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.148497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.148630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.148714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.148918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.149042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.155200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.155326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.155456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.155540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.161073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.161201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.161341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.161422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.161631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.161774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.161948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.162963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.163087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.178880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.179005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.179127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.179211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.182928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.183070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.186125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.186251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.186378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.186462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.190600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.190725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.193712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.193855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.196881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.197977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.198069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.198285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.198435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.213749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.214055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.214181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.214317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.214397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.214616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.214743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.214926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.221383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.221685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.222912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.223231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.224416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.224688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.224810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.224982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.227379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.227638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.227762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.227898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.227978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.228195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.228319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.228454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.228610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.228854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.239932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.240057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.240184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.240267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.240478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.240621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.240759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.240834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.241111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.241235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.241384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.241468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.241652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.241776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.256771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.257077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.259644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.259984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.262496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.262855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.264013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.264325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.265455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.265736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.265884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.266080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.266221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.266476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.272386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.272785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.273827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.274247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.276655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.277040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.277163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.277298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.277494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.277630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.277875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.278113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.285289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.285566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.285823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.285944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.286155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.286429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.292958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.293238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.293520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.293642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81731) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:21:16.293770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.293928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.294029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.294148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.294306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.294438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.294634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.294757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.294912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.295054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.295187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.295347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.295481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.295633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.295756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.295883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.296010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.296145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.296274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.296400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.296525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.296651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.296774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.297032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81731) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:21:16.330143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a861fdc9c0 pid: 81732 (default app) Sep 30 09:21:16.330372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a861fdc9c0 pid: 81731 (default app) Sep 30 09:21:16.333408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd806-8a2c-4413-8a16-2fad421d40f2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:16.333689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd806-8a2c-4413-8a16-2fad421d40f2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:16.333980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd806-8a2c-4413-8a16-2fad421d40f2 None None] PATH_INFO: `/v3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:16.338178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Sep 30 09:21:16 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:23.166877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d64d-283a-402b-8556-c8c5f8eb445b None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:23.167418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d64d-283a-402b-8556-c8c5f8eb445b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:23.167418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d64d-283a-402b-8556-c8c5f8eb445b None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:23.175262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:23.184055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:23.184480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:23.184614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:23.256981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: INFO dbcounter [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] Registered counter for database keystone Sep 30 09:21:23.278138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG oslo_db.sqlalchemy.engines [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 09:21:23.290314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writer thread running {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 09:21:23.473206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG passlib.handlers.bcrypt [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81732) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 09:21:23.473496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG passlib.handlers.bcrypt [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81732) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 09:21:23.533119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:23.534750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:23.670341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 30 09:21:24.197869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90d64d-283a-402b-8556-c8c5f8eb445b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:24.271071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: INFO dbcounter [None req-ce90d64d-283a-402b-8556-c8c5f8eb445b None None] Registered counter for database keystone Sep 30 09:21:24.296192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG oslo_db.sqlalchemy.engines [None req-ce90d64d-283a-402b-8556-c8c5f8eb445b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 09:21:24.308201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writer thread running {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 09:21:24.436203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90d64d-283a-402b-8556-c8c5f8eb445b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:24.443295 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e409ba3-7da8-48ae-b1b9-93a13326be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:24.443929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e409ba3-7da8-48ae-b1b9-93a13326be2a admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:24.444202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e409ba3-7da8-48ae-b1b9-93a13326be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:24.444475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e409ba3-7da8-48ae-b1b9-93a13326be2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:24.454025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e409ba3-7da8-48ae-b1b9-93a13326be2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:24.505461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5e409ba3-7da8-48ae-b1b9-93a13326be2a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 09:21:24.505806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e409ba3-7da8-48ae-b1b9-93a13326be2a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:24.516240 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 30 09:21:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:21:24.524383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:24.546891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437131a8-acb9-499e-8548-60165b0f8210 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:24.553026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea297d9d-7459-41a1-b95e-697b41f9b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:24.554233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297d9d-7459-41a1-b95e-697b41f9b3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:24.554509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297d9d-7459-41a1-b95e-697b41f9b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:24.554767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297d9d-7459-41a1-b95e-697b41f9b3c3 admin admin] PATH_INFO: `/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:24.556515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea297d9d-7459-41a1-b95e-697b41f9b3c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=ebff7cf09dfd4e619d4653fe8d95360a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:24.612648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea297d9d-7459-41a1-b95e-697b41f9b3c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 09:21:24.613007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea297d9d-7459-41a1-b95e-697b41f9b3c3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:24.617764 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Sep 30 09:21:24 2022] GET /identity/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a => generated 344 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:26.733583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be572-905c-4292-92ee-819303c914f2 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:26.734208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be572-905c-4292-92ee-819303c914f2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:26.734208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be572-905c-4292-92ee-819303c914f2 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:26.738640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:21:26.745208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eff45e-10ae-4b64-ab42-a64650ba88a7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:26.745969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eff45e-10ae-4b64-ab42-a64650ba88a7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:26.746115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eff45e-10ae-4b64-ab42-a64650ba88a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:26.781778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-61eff45e-10ae-4b64-ab42-a64650ba88a7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:26.783893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-61eff45e-10ae-4b64-ab42-a64650ba88a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:26.793727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 30 09:21:27.066154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be572-905c-4292-92ee-819303c914f2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:27.080953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be572-905c-4292-92ee-819303c914f2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:27.086381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc907125-3833-4055-a5c5-872c1f2845a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:27.086984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc907125-3833-4055-a5c5-872c1f2845a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:27.087254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc907125-3833-4055-a5c5-872c1f2845a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:27.087521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc907125-3833-4055-a5c5-872c1f2845a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:27.096285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc907125-3833-4055-a5c5-872c1f2845a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:27.098085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc907125-3833-4055-a5c5-872c1f2845a5 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:27.107849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 30 09:21:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:21:27.113400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eff45e-10ae-4b64-ab42-a64650ba88a7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:27.123136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eff45e-10ae-4b64-ab42-a64650ba88a7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:27.129976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ae69-80d8-4717-b389-16c912675eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:27.131042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ae69-80d8-4717-b389-16c912675eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:27.131542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ae69-80d8-4717-b389-16c912675eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:27.132033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ae69-80d8-4717-b389-16c912675eaf admin admin] PATH_INFO: `/v3/users/ea3875a2ed124d19b88d1590553ab6d2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:27.134394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ae69-80d8-4717-b389-16c912675eaf admin admin] RBAC: Authorizing `identity:get_user(user_id=ea3875a2ed124d19b88d1590553ab6d2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:27.137411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ae69-80d8-4717-b389-16c912675eaf admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:27.139829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Sep 30 09:21:27 2022] GET /identity/v3/users/ea3875a2ed124d19b88d1590553ab6d2 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:29.340285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8acdd-c9e5-4f69-a2ce-7c4ff95822a1 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:29.340842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8acdd-c9e5-4f69-a2ce-7c4ff95822a1 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:29.340842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8acdd-c9e5-4f69-a2ce-7c4ff95822a1 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:29.342198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:29.347555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2e29-2e9c-420d-99c4-c59d0e27f8a8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:29.347984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2e29-2e9c-420d-99c4-c59d0e27f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:29.348082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2e29-2e9c-420d-99c4-c59d0e27f8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:29.366692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3b2c2e29-2e9c-420d-99c4-c59d0e27f8a8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:29.367862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3b2c2e29-2e9c-420d-99c4-c59d0e27f8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:29.393492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a4ce-a61d-4f46-a67a-d2aefae79ada None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:29.393763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a4ce-a61d-4f46-a67a-d2aefae79ada None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:29.394063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a4ce-a61d-4f46-a67a-d2aefae79ada None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:29.395377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:29.400380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:29.400656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:29.400919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:29.443365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG passlib.handlers.bcrypt [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81731) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 09:21:29.443752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG passlib.handlers.bcrypt [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81731) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 09:21:29.451095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:29.492507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:29.494152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:29.594228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:29.715290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c2e29-2e9c-420d-99c4-c59d0e27f8a8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:29.740893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:29.824806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c2e29-2e9c-420d-99c4-c59d0e27f8a8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:29.854052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:29.859908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:29.860548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:29.860856 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:29.861136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:29.872276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:29.881249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:29.882306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:29.883143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:29.888224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:29.959571 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537042fc-ea09-45c7-b640-5e9db45042cb None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:29.961937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:29.969476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:29.988124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021bf17-7707-4ca6-bddd-d54937ddfea1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:29.996388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:29.997285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:29.997556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:29.997842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:30.022004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:30.022798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:30.023083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:30.023378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:30.024044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:30.024350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:30.025753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:30.037300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:30.043388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:30.066423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:30.067954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:30.141214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040f99-0ccc-4702-97ee-50191f61e009 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:30.164986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:30.171536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:30.174353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:30.179092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:30.179742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:30.180015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:30.180283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] PATH_INFO: `/v3/users/ea3875a2ed124d19b88d1590553ab6d2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:30.181416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] RBAC: Authorizing `identity:get_user(user_id=ea3875a2ed124d19b88d1590553ab6d2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:30.182926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:30.184501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:30 2022] GET /identity/v3/users/ea3875a2ed124d19b88d1590553ab6d2 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:30.189989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:30.204454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:30.269811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6914-1540-40e3-b4ac-408ebd857580 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:30.289035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ab497-7861-4570-b842-03f8665a376c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:30.303968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:30.304869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:30.305145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:30.305410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:30.323586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:30.323904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:30.324225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:30.324501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:30.324771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:30.325396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:30.326029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:30.327475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:30.329032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:30.334957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:21:30.343827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:30.345043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:21:30.346905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:21:30.346905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:21:30.346905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:21:30.346905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:21:30.350814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:30.405045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:30.418189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:30.438216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff324df-af07-4443-a0ab-728210371c9a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:30.449590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa9166-9efe-4fa6-9cf3-0d617acc500e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:30.472341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b6ad4-4b00-4549-b79b-7cecfa26d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:30.472945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b6ad4-4b00-4549-b79b-7cecfa26d93d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:30.473216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b6ad4-4b00-4549-b79b-7cecfa26d93d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:30.473481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b6ad4-4b00-4549-b79b-7cecfa26d93d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:30.474231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b6ad4-4b00-4549-b79b-7cecfa26d93d None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.domain.id=default, user.id=ea3875a2ed124d19b88d1590553ab6d2) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:30.474530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b6ad4-4b00-4549-b79b-7cecfa26d93d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:30.475988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b6ad4-4b00-4549-b79b-7cecfa26d93d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:30.482665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 30 09:21:30 2022] GET /identity/v3/role_assignments?user.id=ea3875a2ed124d19b88d1590553ab6d2&scope.domain.id=default&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:30.483913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5fbf-58e8-4ff5-8eb0-f7c638191a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:30.484530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5fbf-58e8-4ff5-8eb0-f7c638191a32 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:30.484801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5fbf-58e8-4ff5-8eb0-f7c638191a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:30.485069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5fbf-58e8-4ff5-8eb0-f7c638191a32 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:30.485722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5fbf-58e8-4ff5-8eb0-f7c638191a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:30.486054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5fbf-58e8-4ff5-8eb0-f7c638191a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:30.487502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5fbf-58e8-4ff5-8eb0-f7c638191a32 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:30.507938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:32.813751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41319-1b38-4a2f-8f1b-e057f718d668 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:32.814935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41319-1b38-4a2f-8f1b-e057f718d668 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:32.815402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41319-1b38-4a2f-8f1b-e057f718d668 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:32.816924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:32.822305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fd73-e7cd-4ea6-8ae2-9976c7f40867 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:32.823180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fd73-e7cd-4ea6-8ae2-9976c7f40867 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:32.823662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fd73-e7cd-4ea6-8ae2-9976c7f40867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:32.851587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6117fd73-e7cd-4ea6-8ae2-9976c7f40867 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:32.853130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6117fd73-e7cd-4ea6-8ae2-9976c7f40867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:32.948231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:33.189777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f63fd-c8ea-4e04-b2fe-ff1024361db1 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.190453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f63fd-c8ea-4e04-b2fe-ff1024361db1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.190925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f63fd-c8ea-4e04-b2fe-ff1024361db1 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.192695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:33.197781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84be06-8ec6-47cd-88de-a79c77066b61 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.198374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84be06-8ec6-47cd-88de-a79c77066b61 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.198854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84be06-8ec6-47cd-88de-a79c77066b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.223274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0d84be06-8ec6-47cd-88de-a79c77066b61 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:33.224808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0d84be06-8ec6-47cd-88de-a79c77066b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:33.277245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:33.310848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:33.446583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f63fd-c8ea-4e04-b2fe-ff1024361db1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:33.576462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f63fd-c8ea-4e04-b2fe-ff1024361db1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:33.637785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:33.638830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.639305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.642168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.658754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:33.664786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:33.665631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:33.666433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:33.669116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 14/26] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:21:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:33.670953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43cef7-735f-46d8-a27d-a3dfc383b994 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.671223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43cef7-735f-46d8-a27d-a3dfc383b994 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.671483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43cef7-735f-46d8-a27d-a3dfc383b994 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.672856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:33.675620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:33.680631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:33.693477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a18a-0ba8-4cea-a4ed-a877f62ef9a6 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.693768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a18a-0ba8-4cea-a4ed-a877f62ef9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.694078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a18a-0ba8-4cea-a4ed-a877f62ef9a6 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.695407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 14/28] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:33.700429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f2b3-8ee1-49cd-9e62-c2bc33b0ea2f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.700704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f2b3-8ee1-49cd-9e62-c2bc33b0ea2f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.701111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1f2b3-8ee1-49cd-9e62-c2bc33b0ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.729879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-fdf1f2b3-8ee1-49cd-9e62-c2bc33b0ea2f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:33.732393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fdf1f2b3-8ee1-49cd-9e62-c2bc33b0ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:33.838036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:33.839247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29d6d-b278-4770-a8d7-cba6c162afeb None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.839528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29d6d-b278-4770-a8d7-cba6c162afeb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.839850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29d6d-b278-4770-a8d7-cba6c162afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.844853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7564a-381a-44ca-bfbf-5be6c6c7af62 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:33.874703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-17b29d6d-b278-4770-a8d7-cba6c162afeb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:33.877184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-17b29d6d-b278-4770-a8d7-cba6c162afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:33.909441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:33.910074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:33.910347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:33.910612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:33.911267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:33.911561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:33.917708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:33.935117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:33.937022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.018020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:34.018897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29d6d-b278-4770-a8d7-cba6c162afeb None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.026736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:34.097047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:34.110760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd92807-24ef-4e04-8dc3-50d4c4d2a8ef None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:34.178521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:34.179171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.179447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.179714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.191393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:34.192898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:21:34.209917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:34.211036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:21:34.212004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:21:34.212004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:21:34.212004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:34.213754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:34.214685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.275672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29d6d-b278-4770-a8d7-cba6c162afeb None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:34.321526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17706-4cd6-4905-8f90-d42c48b47d17 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:34.323885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430990a-8142-4195-8632-64be0a086331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:34.324544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430990a-8142-4195-8632-64be0a086331 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.324992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430990a-8142-4195-8632-64be0a086331 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.325399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430990a-8142-4195-8632-64be0a086331 None admin] PATH_INFO: `/v3/users/ea3875a2ed124d19b88d1590553ab6d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.328962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430990a-8142-4195-8632-64be0a086331 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3875a2ed124d19b88d1590553ab6d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:34.330711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430990a-8142-4195-8632-64be0a086331 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:34.332519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 17/33] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:34 2022] GET /identity/v3/users/ea3875a2ed124d19b88d1590553ab6d2 => generated 247 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:34.333417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430990a-8142-4195-8632-64be0a086331 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.344693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:34.362100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:34.362951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.363415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.363846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.364652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:34.366259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:34.478325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430990a-8142-4195-8632-64be0a086331 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:34.480994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:34.497237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 30 09:21:34 2022] POST /identity/v3/roles => generated 225 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:34.498261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.518190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:34.519109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.519624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.520348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.521158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:34.521599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:34.523346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:34.538078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:34.539493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.618746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b904f-3a85-4820-be71-2aa3f3795064 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:34.662795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:34.664339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.664780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.665186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.667438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:34.669315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:34.671614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 18/36] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:34.672698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.684702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4e7a4-d462-422e-8529-af0364cd4255 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:34.722630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dfb40-d9e5-48cd-b4f5-4a0bedd56418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:34.723305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dfb40-d9e5-48cd-b4f5-4a0bedd56418 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.723577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dfb40-d9e5-48cd-b4f5-4a0bedd56418 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.723851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dfb40-d9e5-48cd-b4f5-4a0bedd56418 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.724577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dfb40-d9e5-48cd-b4f5-4a0bedd56418 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:34.726228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dfb40-d9e5-48cd-b4f5-4a0bedd56418 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:34.730309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:34.795477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326ef68-c9d6-4e3c-abff-d7d068fbaf53 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:34.831905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f3675-1695-4199-a412-427d3b1a187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:34.832515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3675-1695-4199-a412-427d3b1a187a None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.832790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3675-1695-4199-a412-427d3b1a187a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.833058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3675-1695-4199-a412-427d3b1a187a None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.833689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f3675-1695-4199-a412-427d3b1a187a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:34.835185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f3675-1695-4199-a412-427d3b1a187a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:34.854876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 30 09:21:34 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:34.856365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96640d-55fe-416d-a817-f84e5539a11f None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.856781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96640d-55fe-416d-a817-f84e5539a11f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.861917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96640d-55fe-416d-a817-f84e5539a11f None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.863786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 20/38] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:34.866878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96640d-55fe-416d-a817-f84e5539a11f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:34.879012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:21:34 2022] POST /identity/v3/projects => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:34.880179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409f98a-a8ce-47ed-81f4-9b170b7e32a6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.880463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409f98a-a8ce-47ed-81f4-9b170b7e32a6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.880735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409f98a-a8ce-47ed-81f4-9b170b7e32a6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.882303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 20/40] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:34.883334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f85ad4-6148-4c4c-b648-736c9ec7ceb8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:34.883682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f85ad4-6148-4c4c-b648-736c9ec7ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:34.883962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f85ad4-6148-4c4c-b648-736c9ec7ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:34.907982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-22f85ad4-6148-4c4c-b648-736c9ec7ceb8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:34.910533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-22f85ad4-6148-4c4c-b648-736c9ec7ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:34.916612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:35.003938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:35.005830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f747ef5-9db5-456f-85d1-59c8de888e4f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:35.006383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f747ef5-9db5-456f-85d1-59c8de888e4f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:35.006852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f747ef5-9db5-456f-85d1-59c8de888e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:35.030200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6f747ef5-9db5-456f-85d1-59c8de888e4f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:35.031237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96640d-55fe-416d-a817-f84e5539a11f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:35.032362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6f747ef5-9db5-456f-85d1-59c8de888e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:35.067625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:35.105378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:35.106177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:35.106455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:35.106789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] PATH_INFO: `/v3/domains/default/users/ea3875a2ed124d19b88d1590553ab6d2/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:35.111967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea3875a2ed124d19b88d1590553ab6d2, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:35.113979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:35.136204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Sep 30 09:21:34 2022] PUT /identity/v3/domains/default/users/ea3875a2ed124d19b88d1590553ab6d2/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:21:35.242012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:35.322669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:35.414914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:35.434055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a699c-8352-46cb-b4e6-82760171e755 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:35.471853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:35.472481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:35.472759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:35.473033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:35.473779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:35.475325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:35.492788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 30 09:21:35 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:35.512982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f747ef5-9db5-456f-85d1-59c8de888e4f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:35.635164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f747ef5-9db5-456f-85d1-59c8de888e4f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:35.673078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013f10e-d703-45db-9c94-8b23df54b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:35.673857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013f10e-d703-45db-9c94-8b23df54b4da None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:35.674227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013f10e-d703-45db-9c94-8b23df54b4da None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:35.674624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013f10e-d703-45db-9c94-8b23df54b4da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:35.675827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013f10e-d703-45db-9c94-8b23df54b4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:35.677376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013f10e-d703-45db-9c94-8b23df54b4da None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:35.679284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:35.684746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:35.794123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8151e-3339-46c9-9cc1-5ad3d89e3e9f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:35.828331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aad44-5734-438f-95ed-3df4089b837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:35.828948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aad44-5734-438f-95ed-3df4089b837a None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:35.829225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aad44-5734-438f-95ed-3df4089b837a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:35.829530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aad44-5734-438f-95ed-3df4089b837a None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:35.830380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247aad44-5734-438f-95ed-3df4089b837a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:35.831821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247aad44-5734-438f-95ed-3df4089b837a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:35.849225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:35.862860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:21:35 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:37.318876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0379c-d915-4477-a5d9-0e8754b9f896 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:37.319441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0379c-d915-4477-a5d9-0e8754b9f896 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:37.319441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0379c-d915-4477-a5d9-0e8754b9f896 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:37.320763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:37.326389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57006a85-2b90-4812-8fb6-f3d45b3ce796 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:37.326816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57006a85-2b90-4812-8fb6-f3d45b3ce796 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:37.327042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57006a85-2b90-4812-8fb6-f3d45b3ce796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:37.345828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-57006a85-2b90-4812-8fb6-f3d45b3ce796 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:37.347357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-57006a85-2b90-4812-8fb6-f3d45b3ce796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:37.415580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:37.679764 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0379c-d915-4477-a5d9-0e8754b9f896 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:37.708704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:37.786121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0379c-d915-4477-a5d9-0e8754b9f896 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:37.819033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd9f2-8d33-4d1c-b166-61d7311380d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:37.819662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd9f2-8d33-4d1c-b166-61d7311380d7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:37.819933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd9f2-8d33-4d1c-b166-61d7311380d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:37.820202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd9f2-8d33-4d1c-b166-61d7311380d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:37.830821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcd9f2-8d33-4d1c-b166-61d7311380d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-0cfcd9f2-8d33-4d1c-b166-61d7311380d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:37.835581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:37.836438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:37.837170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:37.842721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57006a85-2b90-4812-8fb6-f3d45b3ce796 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:37.947216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57006a85-2b90-4812-8fb6-f3d45b3ce796 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:37.973070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:37.982917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:37.983530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:37.983802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:37.984069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:37.984727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:37.985020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:37.986453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:37.991459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a02b0-aef5-4b17-bde2-dadaf26fe2eb None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:37.991736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a02b0-aef5-4b17-bde2-dadaf26fe2eb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:37.992009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a02b0-aef5-4b17-bde2-dadaf26fe2eb None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:37.993336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 26/50] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:21:37.998211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb702-d221-4ea2-840b-7ab2bca08825 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:37.998487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb702-d221-4ea2-840b-7ab2bca08825 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:37.998755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb702-d221-4ea2-840b-7ab2bca08825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:38.001448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:38.004724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:38.017272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-187fb702-d221-4ea2-840b-7ab2bca08825 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:38.018489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-187fb702-d221-4ea2-840b-7ab2bca08825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:38.084695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 27/52] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:38.105692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192bc22-5496-4f73-a373-65647adc22b3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:38.139781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:38.140420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:38.140695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:38.140978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] PATH_INFO: `/v3/users/ea3875a2ed124d19b88d1590553ab6d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:38.142192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] RBAC: Authorizing `identity:get_user(user_id=ea3875a2ed124d19b88d1590553ab6d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:38.143661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:38.145277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:38 2022] GET /identity/v3/users/ea3875a2ed124d19b88d1590553ab6d2 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:38.151125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fb702-d221-4ea2-840b-7ab2bca08825 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:38.170711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:38.258404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fb702-d221-4ea2-840b-7ab2bca08825 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:38.294177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:38.294812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:38.295091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:38.295415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:38.296554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:38.298063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:38.299947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 28/54] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:38.305989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:38.347034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:38.366590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:38.409277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592279cf-1992-403c-9acd-e5bc6cd691cb None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:38.431762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:38.452964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3a67-ec95-400d-a3c1-625d6fbc42fe None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:38.497154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:38.497973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:38.498247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:38.498548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:38.499826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:38.501343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:38.503019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:38.508910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:38.553066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ff967-beb2-47bc-9635-b501809dae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:38.553686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ff967-beb2-47bc-9635-b501809dae91 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:38.553990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ff967-beb2-47bc-9635-b501809dae91 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:38.554264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ff967-beb2-47bc-9635-b501809dae91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:38.554989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ff967-beb2-47bc-9635-b501809dae91 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.domain.id=default, user.id=ea3875a2ed124d19b88d1590553ab6d2) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:38.555292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ff967-beb2-47bc-9635-b501809dae91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:38.556747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ff967-beb2-47bc-9635-b501809dae91 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:38.565054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 30 09:21:38 2022] GET /identity/v3/role_assignments?user.id=ea3875a2ed124d19b88d1590553ab6d2&scope.domain.id=default&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 530 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:38.617075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32509-c4af-496f-b477-d73ea2029a37 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:38.655270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766fdb5-350e-433c-88e9-bd9401d6ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:38.655893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766fdb5-350e-433c-88e9-bd9401d6ad8f None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:38.656170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766fdb5-350e-433c-88e9-bd9401d6ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:38.656427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766fdb5-350e-433c-88e9-bd9401d6ad8f None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:38.657100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766fdb5-350e-433c-88e9-bd9401d6ad8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:38.658844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766fdb5-350e-433c-88e9-bd9401d6ad8f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:38.689559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 30 09:21:38 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:40.916918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44239-4913-4e65-8923-b5f9c76cde0d None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:40.917437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44239-4913-4e65-8923-b5f9c76cde0d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:40.917437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44239-4913-4e65-8923-b5f9c76cde0d None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:40.918814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:40.925131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11db64-13b2-4b1e-b738-0050d46c000e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:40.925859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11db64-13b2-4b1e-b738-0050d46c000e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:40.926049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11db64-13b2-4b1e-b738-0050d46c000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:40.936161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:40.950139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fb11db64-13b2-4b1e-b738-0050d46c000e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:40.951355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fb11db64-13b2-4b1e-b738-0050d46c000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:41.020574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:41.287639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a44239-4913-4e65-8923-b5f9c76cde0d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:41.403748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a44239-4913-4e65-8923-b5f9c76cde0d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:41.423948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:41.440080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed5366-f110-4cd5-89db-89fb1a59beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:41.440709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed5366-f110-4cd5-89db-89fb1a59beaf None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:41.440987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed5366-f110-4cd5-89db-89fb1a59beaf None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:41.441262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed5366-f110-4cd5-89db-89fb1a59beaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:41.442488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed5366-f110-4cd5-89db-89fb1a59beaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:41.443945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed5366-f110-4cd5-89db-89fb1a59beaf None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:41.445510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:41.451845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11db64-13b2-4b1e-b738-0050d46c000e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:41.576592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11db64-13b2-4b1e-b738-0050d46c000e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:41.614370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583813c9-a153-4d53-af2c-f85d7d27b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:41.614978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583813c9-a153-4d53-af2c-f85d7d27b2ac None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:41.615251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583813c9-a153-4d53-af2c-f85d7d27b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:41.615521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583813c9-a153-4d53-af2c-f85d7d27b2ac None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:41.616176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583813c9-a153-4d53-af2c-f85d7d27b2ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:41.617642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583813c9-a153-4d53-af2c-f85d7d27b2ac None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:41.627812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:41.645700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:21:41 2022] POST /identity/v3/users => generated 275 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:44.911955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe91c4-44a2-46f4-a965-26615bdd651f None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:44.912940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe91c4-44a2-46f4-a965-26615bdd651f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:44.913405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe91c4-44a2-46f4-a965-26615bdd651f None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:44.915318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:44.916578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbb1f1-c703-41e4-81f4-348f73d36798 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:44.916951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbb1f1-c703-41e4-81f4-348f73d36798 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:44.917160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbb1f1-c703-41e4-81f4-348f73d36798 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:44.918533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 33/63] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:21:44.920652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ca46-c391-4357-8956-59ccbdfbec67 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:44.920934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ca46-c391-4357-8956-59ccbdfbec67 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:44.921203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ca46-c391-4357-8956-59ccbdfbec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:44.925036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ee41-9422-46cf-87a9-d3dd9da394c6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:44.925582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ee41-9422-46cf-87a9-d3dd9da394c6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:44.926088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ee41-9422-46cf-87a9-d3dd9da394c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:44.956966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-3158ca46-c391-4357-8956-59ccbdfbec67 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:44.958761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9224ee41-9422-46cf-87a9-d3dd9da394c6 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:44.959920 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9224ee41-9422-46cf-87a9-d3dd9da394c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:44.962210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3158ca46-c391-4357-8956-59ccbdfbec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:45.095929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 31/64] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:45.098445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:45.350182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c982c-b502-4878-9fb1-9bb95de72467 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.350702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c982c-b502-4878-9fb1-9bb95de72467 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.351157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c982c-b502-4878-9fb1-9bb95de72467 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.352674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 32/66] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:45.358342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c006a9-0f94-4471-8e39-1260236407cd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.358908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c006a9-0f94-4471-8e39-1260236407cd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.360002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c982c-b502-4878-9fb1-9bb95de72467 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:45.360515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c006a9-0f94-4471-8e39-1260236407cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.402662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b4c006a9-0f94-4471-8e39-1260236407cd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:45.405366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b4c006a9-0f94-4471-8e39-1260236407cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:45.510593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:45.511898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c006a9-0f94-4471-8e39-1260236407cd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:45.530268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c982c-b502-4878-9fb1-9bb95de72467 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:45.563904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:45.571445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:45.579865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b0742-15bf-4acb-862d-e73be02689e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:45.581936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b0742-15bf-4acb-862d-e73be02689e7 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.582553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b0742-15bf-4acb-862d-e73be02689e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.582998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b0742-15bf-4acb-862d-e73be02689e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.598826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b0742-15bf-4acb-862d-e73be02689e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-9e9b0742-15bf-4acb-862d-e73be02689e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:45.605878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:45.606714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:45.607477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:21:45.615275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 33/68] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:21:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:45.617095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db7da-5baf-4565-b879-2cf91462027c None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.617598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db7da-5baf-4565-b879-2cf91462027c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.618113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db7da-5baf-4565-b879-2cf91462027c None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.619580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 34/69] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:45.625196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea79e1-8555-45d6-9517-89c2de9d18e2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.625196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea79e1-8555-45d6-9517-89c2de9d18e2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.625464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea79e1-8555-45d6-9517-89c2de9d18e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.643166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c006a9-0f94-4471-8e39-1260236407cd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:45.646872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-76ea79e1-8555-45d6-9517-89c2de9d18e2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:45.648076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-76ea79e1-8555-45d6-9517-89c2de9d18e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:45.680441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:45.681464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.681970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.682525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.693623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:45.698811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:45.699716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:45.700467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:45.701056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:45.701567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:45.741874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 35/71] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:45.743288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01519104-9a5a-4bff-a2ed-cd3fa52936a8 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.743570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01519104-9a5a-4bff-a2ed-cd3fa52936a8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.743840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01519104-9a5a-4bff-a2ed-cd3fa52936a8 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.745124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 36/72] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:45.745822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01519104-9a5a-4bff-a2ed-cd3fa52936a8 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:45.823540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeee41-c0d2-4f62-844e-a23112f6eb71 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:45.836056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:45.860714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01519104-9a5a-4bff-a2ed-cd3fa52936a8 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:45.862327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0478038-cb00-479a-8f25-3d4e0c1b9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:45.862929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0478038-cb00-479a-8f25-3d4e0c1b9eef None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.863360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0478038-cb00-479a-8f25-3d4e0c1b9eef None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.863807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0478038-cb00-479a-8f25-3d4e0c1b9eef None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.864465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0478038-cb00-479a-8f25-3d4e0c1b9eef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:45.864818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0478038-cb00-479a-8f25-3d4e0c1b9eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:45.866230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0478038-cb00-479a-8f25-3d4e0c1b9eef None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:45.871985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:45.875529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:45.880515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc26cfe-460b-44b6-af59-2556f60032ff None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.880515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc26cfe-460b-44b6-af59-2556f60032ff None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.880515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc26cfe-460b-44b6-af59-2556f60032ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.896158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ebc26cfe-460b-44b6-af59-2556f60032ff None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:45.897417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ebc26cfe-460b-44b6-af59-2556f60032ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:45.902264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:45.902874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:45.903146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:45.903409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:45.904058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:45.904352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:45.905728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:45.920090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:45.921111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:45.965397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 38/75] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:45.970802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc26cfe-460b-44b6-af59-2556f60032ff None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.031910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781952a-dd6f-456f-a9a9-202370ed4e58 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.071524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.072161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.072433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.072707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.083550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:46.088735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:46.089568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:21:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:46.090659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.100280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc26cfe-460b-44b6-af59-2556f60032ff None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.102168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.123720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.136885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.137531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.137829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.138117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] PATH_INFO: `/v3/users/ea3875a2ed124d19b88d1590553ab6d2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.139266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3875a2ed124d19b88d1590553ab6d2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.140749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.142973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:45 2022] GET /identity/v3/users/ea3875a2ed124d19b88d1590553ab6d2 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:46.143744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.200844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211983-ae0f-4644-b069-bf0ff32d0a6c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.236140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.236812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.237375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.237653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.251963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0610a5-30a4-4d26-a79f-0073288e4400 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.252528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.254064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.255688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:46.257544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.285880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.286514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.286795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.287064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.299855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:46.304706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:46.305561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:46.306375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:46.307001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.337954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.348251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.360923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec87b45-9d43-4075-a794-85da6281bb0f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.396235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.396780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.397041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.397303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.398005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:46.398295 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.399743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.407659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:46.407883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335f8ae-2017-4130-83a8-860acc4c553f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.413143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.444053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.444669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.444949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.445217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.509045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72dfa0-f1d9-4954-9123-8903f9eedf4d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.511878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.513439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.541947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.542151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.542784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.543100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.543410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.544982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.546470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.549939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:46.549939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.568551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.618467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:46.618467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.655896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec611c-49f2-44af-8b85-528fb0b66c4c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.688312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.688957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.689311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.689582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.715843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6bed8-8982-4e13-a046-3efbb2eb7b1a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.745863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.752565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.753175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.753455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.753744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.754414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:46.754711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.756112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.759738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.761216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.764532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:46.765320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.780966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.860650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8159fe-6288-4640-9e23-1280f4d9a3f7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.860939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:46.861779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.894940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.895569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.895842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.896108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.897254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.898739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:46.900304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:46.904856 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:46.960507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f574-48e7-4886-9f0a-efded4e4c3b1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:46.963582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.978099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:46.994400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:46.995010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:46.995285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:46.995560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:46.996207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:46.997645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.003866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191bce4-606e-4e7e-94e4-1e975435e89a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:47.025868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 43/86] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:21:46 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:47.026711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.062300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:47.063457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:47.064346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:47.065020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:47.067049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:47.068771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.078135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:46 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:47.078135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.148967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85836e-ece9-4002-907d-a2e07466c3fe None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:47.190182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:47.190732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06551c32-c802-4427-a1ee-44c1196d4e47 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:47.190839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:47.191103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:47.191384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:47.192601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:47.194107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.195743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:47.200583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.227368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:47.238640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:47.239285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:47.239563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:47.239836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:47.240975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:47.242482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.244141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:47.244909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.254101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:47.325697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c37d-feaa-405d-aa49-d73d292f02f1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:47.367312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:47.367937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:47.368228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:47.368495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:47.370870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0792-5a26-4248-a934-966accd01816 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:47.412172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:47.412857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:47.413141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:47.413414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:47.414589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=ea3875a2ed124d19b88d1590553ab6d2) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:47.414898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:47.416373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.422428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/role_assignments?user.id=ea3875a2ed124d19b88d1590553ab6d2&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:47.423317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.453636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:47.455671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.503498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:47.512375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:47.575948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63f07d-cf56-472a-9d3e-fa9b391c141d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:47.622035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 45/91] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:47.622937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.641915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:47.642587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:47.642871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:47.643145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:47.749872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:47.749872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.810927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:47.824035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3222292-836f-49a1-a641-b3b1c3b9ac8f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:47.876021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 47/92] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:47.877427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.887429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:47.888061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:47.888342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:47.888612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:47.889343 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=bc74d33b575343409500f3f8dca19cca) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:47.889652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:47.891146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:47.898023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/role_assignments?user.id=bc74d33b575343409500f3f8dca19cca&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:47.903293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:47.916786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:48.100335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d077b-addd-4702-92c7-03bef2194810 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:48.139054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:48.139889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:48.140262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:48.140634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] PATH_INFO: `/v3/projects/2862a0717baf47d0aaa8e8ac7e928495` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:48.142095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] RBAC: Authorizing `identity:get_project(project_id=2862a0717baf47d0aaa8e8ac7e928495)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:48.143767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:48.145986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 47/94] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/projects/2862a0717baf47d0aaa8e8ac7e928495 => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:48.147832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8044ec-60ce-4770-9090-bfcbd7e07ad5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:48.156996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:48.209384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:48.210218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:48.210591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:48.211225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:48.213392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:48.215013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:48.217299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 48/95] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:47 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:48.223804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:48.257592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:48.300098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:48.374430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e8045-94c7-40d3-be85-45c55da5bacf None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:48.425675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4567-c776-4ed3-b068-bc2a441a7032 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:48.462529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2210e-cdd9-45bb-a5e1-b881b27c22ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:48.463223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2210e-cdd9-45bb-a5e1-b881b27c22ff None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:48.463502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2210e-cdd9-45bb-a5e1-b881b27c22ff None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:48.463911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2210e-cdd9-45bb-a5e1-b881b27c22ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:48.464654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2210e-cdd9-45bb-a5e1-b881b27c22ff None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=2862a0717baf47d0aaa8e8ac7e928495, user.id=bc74d33b575343409500f3f8dca19cca) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:48.465398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2210e-cdd9-45bb-a5e1-b881b27c22ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:48.466719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2210e-cdd9-45bb-a5e1-b881b27c22ff None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:48.482610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:21:48 2022] GET /identity/v3/role_assignments?user.id=bc74d33b575343409500f3f8dca19cca&scope.project.id=2862a0717baf47d0aaa8e8ac7e928495&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:48.511059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6baae2-6c8a-4aac-ac65-51a021f9ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:48.511699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6baae2-6c8a-4aac-ac65-51a021f9ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:48.511976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6baae2-6c8a-4aac-ac65-51a021f9ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:48.512246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6baae2-6c8a-4aac-ac65-51a021f9ecc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:48.513000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6baae2-6c8a-4aac-ac65-51a021f9ecc5 None admin] RBAC: Adding query filter params (role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=bc74d33b575343409500f3f8dca19cca) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:48.513360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6baae2-6c8a-4aac-ac65-51a021f9ecc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:48.514948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6baae2-6c8a-4aac-ac65-51a021f9ecc5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:48.526456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:21:48 2022] GET /identity/v3/role_assignments?user.id=bc74d33b575343409500f3f8dca19cca&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:50.050931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dd12c-96e0-4721-b6c4-8ee411e43db3 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.051986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dd12c-96e0-4721-b6c4-8ee411e43db3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.052483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dd12c-96e0-4721-b6c4-8ee411e43db3 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:50.054073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:50.059702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19f47-cdb2-4871-80ae-306d8a1c26e5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.060592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19f47-cdb2-4871-80ae-306d8a1c26e5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.061079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19f47-cdb2-4871-80ae-306d8a1c26e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:50.086933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b7f19f47-cdb2-4871-80ae-306d8a1c26e5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:50.088478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b7f19f47-cdb2-4871-80ae-306d8a1c26e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:50.153187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381ba01-8ff1-4ea5-afa9-3767ae361bbb None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.153918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381ba01-8ff1-4ea5-afa9-3767ae361bbb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.154414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381ba01-8ff1-4ea5-afa9-3767ae361bbb None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:50.156047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 50/99] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:21:50.162432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62070-5e01-40a4-9c9d-f145231665c7 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.162999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62070-5e01-40a4-9c9d-f145231665c7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.163457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62070-5e01-40a4-9c9d-f145231665c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:50.179328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 50/100] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:50.189908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-95a62070-5e01-40a4-9c9d-f145231665c7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:50.191341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-95a62070-5e01-40a4-9c9d-f145231665c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:50.275109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 51/101] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:50.768922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f19f47-cdb2-4871-80ae-306d8a1c26e5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:50.798093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a62070-5e01-40a4-9c9d-f145231665c7 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:50.799107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:50.896982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:50.920161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f19f47-cdb2-4871-80ae-306d8a1c26e5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:50.934998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a62070-5e01-40a4-9c9d-f145231665c7 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:50.965153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bef5bb-21f8-4480-aca5-26ba70299913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:50.966393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bef5bb-21f8-4480-aca5-26ba70299913 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.966662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bef5bb-21f8-4480-aca5-26ba70299913 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.966936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bef5bb-21f8-4480-aca5-26ba70299913 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:50.968664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bef5bb-21f8-4480-aca5-26ba70299913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:50.970806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bef5bb-21f8-4480-aca5-26ba70299913 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:50.971909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:50.973283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97989f0-5f60-43ff-948d-f3a5baeafe73 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.973761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97989f0-5f60-43ff-948d-f3a5baeafe73 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.974249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97989f0-5f60-43ff-948d-f3a5baeafe73 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:50.975878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 52/103] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:50.977107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f3c8f-bc92-4d77-9154-60ce338e596d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.977579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f3c8f-bc92-4d77-9154-60ce338e596d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.978081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f3c8f-bc92-4d77-9154-60ce338e596d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:50.979675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 53/104] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:50.984499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f3c8f-bc92-4d77-9154-60ce338e596d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:50.989718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517b6fc-e8ef-42b2-9c15-8deea9b17628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:50.991025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517b6fc-e8ef-42b2-9c15-8deea9b17628 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:50.991490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517b6fc-e8ef-42b2-9c15-8deea9b17628 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:50.991947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517b6fc-e8ef-42b2-9c15-8deea9b17628 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.009227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517b6fc-e8ef-42b2-9c15-8deea9b17628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-2517b6fc-e8ef-42b2-9c15-8deea9b17628 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:51.015057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:51.015900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:51.016986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:21:51.021510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 52/105] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:21:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:51.024535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ffcd-1d30-4c4d-99ff-1db4a57322cc None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.024535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ffcd-1d30-4c4d-99ff-1db4a57322cc None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.024770 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ffcd-1d30-4c4d-99ff-1db4a57322cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.049922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4e20ffcd-1d30-4c4d-99ff-1db4a57322cc None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:51.051122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4e20ffcd-1d30-4c4d-99ff-1db4a57322cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:51.097122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:51.110098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f3c8f-bc92-4d77-9154-60ce338e596d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:51.133819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 53/106] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:51.133819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce58f-f0ef-4410-aece-cbde6e4595f7 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.133819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce58f-f0ef-4410-aece-cbde6e4595f7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.133819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce58f-f0ef-4410-aece-cbde6e4595f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.149895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-77cce58f-f0ef-4410-aece-cbde6e4595f7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:51.150994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-77cce58f-f0ef-4410-aece-cbde6e4595f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:51.168516 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:51.169507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.170033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.170530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.171451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:51.173255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:51.212196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:51.223946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 54/107] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:21:50 2022] POST /identity/v3/projects => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:51.224646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:51.234206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:51.374295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6283-04aa-4a04-a7fe-91557dce2472 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:51.427208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:51.428119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.428563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.429006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.429938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:51.430614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:51.432201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:51.446907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 55/109] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:51.452947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cce58f-f0ef-4410-aece-cbde6e4595f7 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:51.552057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:51.556433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:51.580986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cce58f-f0ef-4410-aece-cbde6e4595f7 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:51.634347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead4a0d-5ffe-4d07-9b7b-a45dc42a16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:51.635014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead4a0d-5ffe-4d07-9b7b-a45dc42a16c8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.635296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead4a0d-5ffe-4d07-9b7b-a45dc42a16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.635569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead4a0d-5ffe-4d07-9b7b-a45dc42a16c8 None admin] PATH_INFO: `/v3/users/ea3875a2ed124d19b88d1590553ab6d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.636744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead4a0d-5ffe-4d07-9b7b-a45dc42a16c8 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3875a2ed124d19b88d1590553ab6d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:51.638345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead4a0d-5ffe-4d07-9b7b-a45dc42a16c8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:51.640279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 55/110] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:51 2022] GET /identity/v3/users/ea3875a2ed124d19b88d1590553ab6d2 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:51.641543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287d899-298c-4d66-9e0a-e8ba5941aa8d None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.642268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287d899-298c-4d66-9e0a-e8ba5941aa8d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.643098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287d899-298c-4d66-9e0a-e8ba5941aa8d None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.645482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 56/111] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:51.646344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fb0f0-4ace-470a-8933-170674ab0e29 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.646684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fb0f0-4ace-470a-8933-170674ab0e29 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.647044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fb0f0-4ace-470a-8933-170674ab0e29 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.648537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 57/112] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:51.649126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fb0f0-4ace-470a-8933-170674ab0e29 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:51.726955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514653c-64e8-4983-85b2-a5a145c6dc26 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:51.728014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:51.765015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784326b-76e2-4dcf-9bd0-607ab5e5962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:51.766172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784326b-76e2-4dcf-9bd0-607ab5e5962b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.766582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784326b-76e2-4dcf-9bd0-607ab5e5962b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.767257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784326b-76e2-4dcf-9bd0-607ab5e5962b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.775658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fb0f0-4ace-470a-8933-170674ab0e29 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:51.779640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784326b-76e2-4dcf-9bd0-607ab5e5962b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b784326b-76e2-4dcf-9bd0-607ab5e5962b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:51.784944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:51.785885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:51.786934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 56/113] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:51.787880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf1da-3275-4da1-b523-4c15fd8a9bf1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.787880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf1da-3275-4da1-b523-4c15fd8a9bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.787880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf1da-3275-4da1-b523-4c15fd8a9bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.806386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f9adf1da-3275-4da1-b523-4c15fd8a9bf1 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:51.807573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f9adf1da-3275-4da1-b523-4c15fd8a9bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:51.813944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5ff2b-f1cb-4be3-ac39-577f911b61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:51.814594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ff2b-f1cb-4be3-ac39-577f911b61a8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.814865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ff2b-f1cb-4be3-ac39-577f911b61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.815131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ff2b-f1cb-4be3-ac39-577f911b61a8 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.816283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5ff2b-f1cb-4be3-ac39-577f911b61a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:51.817723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5ff2b-f1cb-4be3-ac39-577f911b61a8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:51.823995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 58/114] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:51 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:51.823995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab433-cc3e-42ad-a877-0068f5d9dc4c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:51.823995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab433-cc3e-42ad-a877-0068f5d9dc4c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:51.823995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab433-cc3e-42ad-a877-0068f5d9dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:51.839316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-aaeab433-cc3e-42ad-a877-0068f5d9dc4c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:51.840585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-aaeab433-cc3e-42ad-a877-0068f5d9dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:51.883095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:51.901821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 57/115] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:51.901821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf1da-3275-4da1-b523-4c15fd8a9bf1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:51.919438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 59/116] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:51.920798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab433-cc3e-42ad-a877-0068f5d9dc4c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.035527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:52.049533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf1da-3275-4da1-b523-4c15fd8a9bf1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.098205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.098861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.099117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.099389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.116042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab433-cc3e-42ad-a877-0068f5d9dc4c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.120717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:52.131107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:52.131959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:52.132748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 58/117] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:52.135975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.179883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.180911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.181372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.181847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.189831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] RBAC: Adding query filter params (name=member) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:52.190511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:52.192144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:52.201434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 60/118] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:52.202524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.207319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:52.262200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b56e-e7ee-4a7d-aa8b-43a5d8fcc742 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.299462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.300474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.300877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.301111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/ea3875a2ed124d19b88d1590553ab6d2/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.303244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d6f4402df346168c2f6561120c3c31, user_id=ea3875a2ed124d19b88d1590553ab6d2, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:52.304502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:52.312529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cdb38-eb92-4925-aced-4b3767473086 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.330153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 59/119] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:21:52 2022] PUT /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/ea3875a2ed124d19b88d1590553ab6d2/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:21:52.330153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.331967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:52.355728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.356506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.356848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.357212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.358007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:52.358370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:52.359881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:52.370442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 61/120] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:52.371419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.491194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244d2c0-a9a0-4acb-a108-6e1bf5dd3005 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.506010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e7c3-dc7c-41b7-8dda-667d1588c7a0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.512370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:52.543547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.544444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.544722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.544991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.551257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.551841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.552122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.552453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.553714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:52.555365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:52.557036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:52.557843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.557943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:52.563730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:52.565016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:52.565844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:52.570591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.616394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:52.684705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e6d0c-74be-42e1-b468-25c8e7e8d593 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.689969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caecf3-ced3-41a8-871d-7390118dcbb3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.726150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.726894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.727171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.727422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.727531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.728162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.728511 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.728851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] PATH_INFO: `/v3/users/cc12a26f5d534c8597389e96ca614ed4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.739878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:52.745168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] RBAC: Authorizing `identity:get_user(user_id=cc12a26f5d534c8597389e96ca614ed4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:52.746356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:52.747199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:21:52.748175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:21:52.749092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:52.749168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 63/123] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:52.749168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.749315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/users/cc12a26f5d534c8597389e96ca614ed4 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:52.750417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.787870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:52.871674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39c1d-016d-4003-bc0f-e44a2a024813 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.881110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:52.882384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4997ed-1bdd-4523-976a-58a1e12f069e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:52.916727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.917354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.917630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.917945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.919331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:52.921422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:52.923614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:52.924208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:52.929321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:52.930249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:52.930808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:52.931281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:52.932137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:52.932630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:52.934249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:52.943725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:52.944900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.035393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d620f4-330a-480a-8677-186ad0798a7c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.055642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:53.066759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3469-dadd-4624-97f3-5250762a100c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.071691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.072570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.073045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.073510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.112266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.112954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.113260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.113708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.114879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:53.115287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.116691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.121834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:53.132393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 63/127] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:53.133234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.153242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.155109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.268003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 65/128] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:53.273498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.274954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df7d5-d0fc-48d7-aac2-4c58acacc136 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.328736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.329494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.329771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.330072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/bc74d33b575343409500f3f8dca19cca/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.332085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d6f4402df346168c2f6561120c3c31, user_id=bc74d33b575343409500f3f8dca19cca, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.333576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.352810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 64/129] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:21:53 2022] PUT /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/bc74d33b575343409500f3f8dca19cca/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:21:53.353834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.367100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:53.408401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:53.431040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fcc8e-3bf5-4aeb-88c1-abdc0b243459 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.512646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.513327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.515440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.515749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.518424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.519915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.525469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 66/130] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:53 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:53.526383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.560943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653d55a-f9f0-4d72-a835-a81da324684a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.598166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.598806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.599092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.599366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.600528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.602020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.603871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 65/131] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:53 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:53.604448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.676622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e790d4-346a-4762-ae5b-fb54049bb598 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.717850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:53.736758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.738558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.738768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.739036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.741275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.742799 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.744528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 67/132] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:53 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:53.745318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.758638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742fa7-e5db-4de2-ae4e-31607d7680e6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.775331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:53.828078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.829155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.829658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.830148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] PATH_INFO: `/v3/projects/2862a0717baf47d0aaa8e8ac7e928495` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.833645 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=2862a0717baf47d0aaa8e8ac7e928495)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.835384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.837302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 66/133] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:53 2022] GET /identity/v3/projects/2862a0717baf47d0aaa8e8ac7e928495 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:53.839874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.908174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8d812-ec1f-4196-b887-2c63a056fa14 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:53.946977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:53.947940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:53.948497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:53.948930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:53.950545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:53.952141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:53.955060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 68/134] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:53 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:53.956040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:53.965025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03673fa8-271c-4f42-9d31-1ba3e15f2fe6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:54.008680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b65058-5fa9-4501-9f23-77b10a919c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:54.010087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b65058-5fa9-4501-9f23-77b10a919c0c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:54.010830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b65058-5fa9-4501-9f23-77b10a919c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:54.011448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b65058-5fa9-4501-9f23-77b10a919c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:54.012329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b65058-5fa9-4501-9f23-77b10a919c0c None admin] RBAC: Adding query filter params (role.id=4c0caecb94cb472ab6c1d958b8af8df9, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=cc12a26f5d534c8597389e96ca614ed4) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:54.012990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b65058-5fa9-4501-9f23-77b10a919c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:54.015505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b65058-5fa9-4501-9f23-77b10a919c0c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:54.023374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 67/135] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:21:53 2022] GET /identity/v3/role_assignments?user.id=cc12a26f5d534c8597389e96ca614ed4&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=4c0caecb94cb472ab6c1d958b8af8df9 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:54.025553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21043883-8d64-4b07-9583-81f532bd8c2e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:54.026264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21043883-8d64-4b07-9583-81f532bd8c2e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:54.026682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21043883-8d64-4b07-9583-81f532bd8c2e None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:54.028932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 68/136] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:54.030015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21043883-8d64-4b07-9583-81f532bd8c2e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:54.056721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:54.096191 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:54.158268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251898ea-ee51-47b8-961f-6e08dcae34af None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:54.174338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21043883-8d64-4b07-9583-81f532bd8c2e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:54.217968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de101f-e787-45b3-b8c3-314ae7b0cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:54.218891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de101f-e787-45b3-b8c3-314ae7b0cdfd None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:54.219822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de101f-e787-45b3-b8c3-314ae7b0cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:54.220282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de101f-e787-45b3-b8c3-314ae7b0cdfd None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/bc74d33b575343409500f3f8dca19cca/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:54.223769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de101f-e787-45b3-b8c3-314ae7b0cdfd None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d6f4402df346168c2f6561120c3c31, user_id=bc74d33b575343409500f3f8dca19cca, role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:54.225685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de101f-e787-45b3-b8c3-314ae7b0cdfd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:54.233058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:54.233557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:54.235239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:54.235239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] PATH_INFO: `/v3/projects/2862a0717baf47d0aaa8e8ac7e928495/users/bc74d33b575343409500f3f8dca19cca/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:54.243199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2862a0717baf47d0aaa8e8ac7e928495, user_id=bc74d33b575343409500f3f8dca19cca, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:54.245153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:54.254816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 69/137] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:21:54 2022] PUT /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/bc74d33b575343409500f3f8dca19cca/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:21:54.256523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c222f-551d-41fd-ae57-7e17ac7fbc0b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:54.257002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c222f-551d-41fd-ae57-7e17ac7fbc0b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:54.257537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c222f-551d-41fd-ae57-7e17ac7fbc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:54.274322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 69/138] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:21:53 2022] PUT /identity/v3/projects/2862a0717baf47d0aaa8e8ac7e928495/users/bc74d33b575343409500f3f8dca19cca/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:21:54.280508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5c5c222f-551d-41fd-ae57-7e17ac7fbc0b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:54.282268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5c5c222f-551d-41fd-ae57-7e17ac7fbc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:54.362494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:54.750789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:54.876655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59259c89-50df-4339-a0f7-7dad4797d0e7 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:54.915813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f33e0-0311-43b0-bb68-e53edb01c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:54.916465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f33e0-0311-43b0-bb68-e53edb01c37c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:54.916745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f33e0-0311-43b0-bb68-e53edb01c37c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:54.917017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f33e0-0311-43b0-bb68-e53edb01c37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:54.918192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f33e0-0311-43b0-bb68-e53edb01c37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:54.919671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f33e0-0311-43b0-bb68-e53edb01c37c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:54.921573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 70/140] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:21:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:54.927612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c222f-551d-41fd-ae57-7e17ac7fbc0b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:54.940655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:55.004054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3081-bd0f-4dfe-bdeb-f136764e3e11 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:55.004388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3081-bd0f-4dfe-bdeb-f136764e3e11 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:55.004591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3081-bd0f-4dfe-bdeb-f136764e3e11 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:55.006181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 71/141] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:55.011647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e842-23e7-4211-bcc0-4765a4122e28 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:55.011925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e842-23e7-4211-bcc0-4765a4122e28 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:55.012189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e842-23e7-4211-bcc0-4765a4122e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:55.040904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:55.055076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ec10e842-23e7-4211-bcc0-4765a4122e28 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:55.056350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ec10e842-23e7-4211-bcc0-4765a4122e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:55.061112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c222f-551d-41fd-ae57-7e17ac7fbc0b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:55.099377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:55.100414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:55.101003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:55.101653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:55.102528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:55.104326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:55.138824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 71/142] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:21:54 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:21:55.170838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 72/143] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:55.704850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:55.782415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:55.833497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893e517-8fcf-489c-a24d-a3688a365b13 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:55.878172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157e811-db9c-4d0f-aedd-5688fdbc3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:55.878748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e811-db9c-4d0f-aedd-5688fdbc3ede None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:55.879019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e811-db9c-4d0f-aedd-5688fdbc3ede None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:55.879288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e811-db9c-4d0f-aedd-5688fdbc3ede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:55.898972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157e811-db9c-4d0f-aedd-5688fdbc3ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2157e811-db9c-4d0f-aedd-5688fdbc3ede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:55.904799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:55.905753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:21:55.906545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:55.909272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 72/144] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:21:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:55.915867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e842-23e7-4211-bcc0-4765a4122e28 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:56.034545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e842-23e7-4211-bcc0-4765a4122e28 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:56.073020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:56.073647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:56.073947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:56.074214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:56.075208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:56.075515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:56.076895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:56.077337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe02d-4266-4778-9e31-1abd3d922721 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:56.077940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe02d-4266-4778-9e31-1abd3d922721 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:56.078403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe02d-4266-4778-9e31-1abd3d922721 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:56.079353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:56.080591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 73/145] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:56.087502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e7d7-0dc7-4452-bb65-dc058fe2f09f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:56.088141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e7d7-0dc7-4452-bb65-dc058fe2f09f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:56.088669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e7d7-0dc7-4452-bb65-dc058fe2f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:56.088846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 73/146] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:56.098034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:56.122894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3350e7d7-0dc7-4452-bb65-dc058fe2f09f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:56.124462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3350e7d7-0dc7-4452-bb65-dc058fe2f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:56.201396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6c925-75db-49ed-886d-c05f6a7feea2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:56.236108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 74/147] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:56.244779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:56.245442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:56.245857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:56.246133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] PATH_INFO: `/v3/users/ea3875a2ed124d19b88d1590553ab6d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:56.250585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3875a2ed124d19b88d1590553ab6d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:56.252422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:56.254244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 74/148] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:56 2022] GET /identity/v3/users/ea3875a2ed124d19b88d1590553ab6d2 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:56.260080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350e7d7-0dc7-4452-bb65-dc058fe2f09f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:56.332101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:56.389914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350e7d7-0dc7-4452-bb65-dc058fe2f09f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:56.432951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:56.433577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:56.433873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:56.434147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:56.519788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:56.527185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:56.598691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:56.665109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 75/149] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:56.670968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:56.757415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:56.797752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0738-4b5f-4603-b67c-68a0d120a2c0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:56.841343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:56.845390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:56.846114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:56.847315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:56.847315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:56.853889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:56.853889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:56.854433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 75/150] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:56 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:56.860487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:56.975399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26ff3f-5e7f-46f3-b8de-657e412b0632 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:56.992554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85d9c-11c1-4e26-b5e6-235da752edd0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:57.011315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15fc2-2db6-4a60-8172-2c3125a5711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:57.011936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15fc2-2db6-4a60-8172-2c3125a5711e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:57.012199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15fc2-2db6-4a60-8172-2c3125a5711e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:57.012470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15fc2-2db6-4a60-8172-2c3125a5711e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:57.013208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15fc2-2db6-4a60-8172-2c3125a5711e None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=ea3875a2ed124d19b88d1590553ab6d2) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:57.013644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15fc2-2db6-4a60-8172-2c3125a5711e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:57.016798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15fc2-2db6-4a60-8172-2c3125a5711e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:57.017287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:57.025265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 76/151] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:21:56 2022] GET /identity/v3/role_assignments?user.id=ea3875a2ed124d19b88d1590553ab6d2&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:57.025265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57232bf-d015-4ada-8f19-f709ffeb8859 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:57.025265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57232bf-d015-4ada-8f19-f709ffeb8859 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:57.025265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57232bf-d015-4ada-8f19-f709ffeb8859 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:57.026331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 77/152] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:57.031226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66770be7-088c-4cf6-929e-f2061e622536 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:57.031605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66770be7-088c-4cf6-929e-f2061e622536 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:57.031930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66770be7-088c-4cf6-929e-f2061e622536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:57.053678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:57.054755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:57.055253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:57.055700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:57.066966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-66770be7-088c-4cf6-929e-f2061e622536 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:57.069078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-66770be7-088c-4cf6-929e-f2061e622536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:57.072547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:57.077860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:57.078775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:57.079660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:57.086395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 76/153] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:21:57.098032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:57.121825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:57.203379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:21:57.253971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7830-aa1d-488e-ad37-c7baa036c96b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:57.305259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:57.306281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:57.306757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:57.307244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:57.308128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:57.308629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:57.310278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:57.325026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 77/155] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:57.330666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66770be7-088c-4cf6-929e-f2061e622536 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:57.471817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66770be7-088c-4cf6-929e-f2061e622536 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:57.503496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:57.511441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:57.513344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:57.513344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:57.513344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:57.518578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:57.520078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:57.522092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 79/156] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:57 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:57.527631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:57.672735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:57.714014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50b68-31e0-4a18-959d-3ad8e5a989ba None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:57.768008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:57.768750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:57.768981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:57.769252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:57.770397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:57.866506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:57.868031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:57.986422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb25515-5cfc-4f05-abd8-8a81100de41b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:58.001007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:58.050155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:21:58.058661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:58.062960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:58.063741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.064016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.064283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.074970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:58.079804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:58.080871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:21:58.081656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 80/158] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:21:58.089360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:58.194622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:58.234431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f388f-fa1d-4195-bd18-77c3c325e278 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:58.276270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599db58-187b-4be7-8713-d9e218ca82bf None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:58.302449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b7ea7-7ec0-46a3-82f2-6ac024af6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:58.303502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b7ea7-7ec0-46a3-82f2-6ac024af6c8c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.303998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b7ea7-7ec0-46a3-82f2-6ac024af6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.304467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b7ea7-7ec0-46a3-82f2-6ac024af6c8c None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.310547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b7ea7-7ec0-46a3-82f2-6ac024af6c8c None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:58.312241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b7ea7-7ec0-46a3-82f2-6ac024af6c8c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:58.313070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:58.313743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.313998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 79/159] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:58 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:58.314351 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.314622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.315145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9742-5851-4e8f-b69d-11c092f55e23 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.315260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:58.315434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9742-5851-4e8f-b69d-11c092f55e23 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.315585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:58.315670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9742-5851-4e8f-b69d-11c092f55e23 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.316834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 80/160] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:58.317824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735bdca-d2a5-4b47-80ca-383aa325879a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.321717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:58.326222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735bdca-d2a5-4b47-80ca-383aa325879a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.326497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735bdca-d2a5-4b47-80ca-383aa325879a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.327817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 81/161] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:21:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:21:58.328882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9121d89-3f32-48a5-92cd-d71dbd872377 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.329184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9121d89-3f32-48a5-92cd-d71dbd872377 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.329449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9121d89-3f32-48a5-92cd-d71dbd872377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.330869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 81/162] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:58.331748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:58.371831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a9121d89-3f32-48a5-92cd-d71dbd872377 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:58.376279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a9121d89-3f32-48a5-92cd-d71dbd872377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:58.454982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:58.472964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33feb-7ac8-4daa-a7db-859a94f36941 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:58.490102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:58.508086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:58.508703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.508973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.509242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.509987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=bc74d33b575343409500f3f8dca19cca) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:58.510288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:58.511728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:58.515965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 82/163] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:58.517076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b3e0-d383-4965-8fb8-fe8a6d1f283d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.517358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b3e0-d383-4965-8fb8-fe8a6d1f283d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.517628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b3e0-d383-4965-8fb8-fe8a6d1f283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.518682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 82/164] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:21:58 2022] GET /identity/v3/role_assignments?user.id=bc74d33b575343409500f3f8dca19cca&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:58.519354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:58.554206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-aec6b3e0-d383-4965-8fb8-fe8a6d1f283d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:21:58.555678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-aec6b3e0-d383-4965-8fb8-fe8a6d1f283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:21:58.649380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b522bc-9706-4a5c-9067-1a4525165eaa None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:58.685108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:58.685759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.686053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.686350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] PATH_INFO: `/v3/users/cc12a26f5d534c8597389e96ca614ed4` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.687527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] RBAC: Authorizing `identity:get_user(user_id=cc12a26f5d534c8597389e96ca614ed4)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:58.689274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:58.691360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 83/165] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:58 2022] GET /identity/v3/users/cc12a26f5d534c8597389e96ca614ed4 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:58.691735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 83/166] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:21:58.698949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:58.778238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:58.829679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170651fd-023a-4f46-89ce-7a3dc952b175 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:58.863353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:58.863992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:58.864263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:58.864526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:58.865646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:58.867137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:58.869065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 84/167] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:21:58 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:58.874646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b3e0-d383-4965-8fb8-fe8a6d1f283d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.011166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b3e0-d383-4965-8fb8-fe8a6d1f283d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:59.013239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:59.055386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:59.056048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:59.056316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:59.056578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/cc12a26f5d534c8597389e96ca614ed4/roles/4c0caecb94cb472ab6c1d958b8af8df9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:59.063034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d6f4402df346168c2f6561120c3c31, user_id=cc12a26f5d534c8597389e96ca614ed4, role_id=4c0caecb94cb472ab6c1d958b8af8df9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:59.064752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:59.078018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.095654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 84/168] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:21:58 2022] PUT /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31/users/cc12a26f5d534c8597389e96ca614ed4/roles/4c0caecb94cb472ab6c1d958b8af8df9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:21:59.226076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7257d7a-f67a-4893-be2f-261318ccb3a5 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:59.254100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:59.264094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.273488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:59.274480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:59.275089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:59.275585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:59.290075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:59.296722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:59.297610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:21:59.298507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:21:59.301257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 85/169] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:21:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:21:59.307600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.436218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c1276-a77f-40d5-ade6-effaae4150af None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:59.463525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b403819-08ec-44b0-9ee4-ca496df7457b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:59.522858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:59.523313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:59.523551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:59.523812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:59.529166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:59.529983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:59.530518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:59.531001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:59.531810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:59.532278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:59.533824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:59.544691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 86/170] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:21:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:59.550556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:21:59.551085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:21:59.555483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:21:59.556382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:21:59.557271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 85/171] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:21:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:21:59.562814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.603599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:59.605517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:59.680046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8c960-52ff-490e-8fc1-b7e01c1e5c6e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:59.720976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:59.721538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:59.721819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:59.722099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:59.723277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:59.724714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:59.726333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 87/172] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:59 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:21:59.731999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.765784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64389-e362-4c93-b310-a57e9ba25f80 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:59.831057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:59.831678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:59.831946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:59.832217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:59.832889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:21:59.833183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:59.837269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:21:59.857578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 86/173] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:21:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:21:59.861369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7128-d33f-4bdf-b906-14f160d60814 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:21:59.863483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:21:59.882951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:21:59.922933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86014e-75b9-4257-9e68-08831eaeacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:21:59.923672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86014e-75b9-4257-9e68-08831eaeacbe None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:21:59.923941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86014e-75b9-4257-9e68-08831eaeacbe None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:21:59.924208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86014e-75b9-4257-9e68-08831eaeacbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:21:59.998304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86014e-75b9-4257-9e68-08831eaeacbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:21:59.999381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86014e-75b9-4257-9e68-08831eaeacbe None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:00.032766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:00.061809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094589b-81b8-40f3-81f8-f41f92722ad6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:00.105346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 88/174] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:21:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:00.111349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b983ec-41df-49cf-983b-041e1a6b2543 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.111917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b983ec-41df-49cf-983b-041e1a6b2543 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.112397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b983ec-41df-49cf-983b-041e1a6b2543 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.113931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 89/175] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:00.115827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b983ec-41df-49cf-983b-041e1a6b2543 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:00.127866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:00.142238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b7608-1881-4c63-ad66-6c841b6785cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:00.142910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b7608-1881-4c63-ad66-6c841b6785cd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.143190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b7608-1881-4c63-ad66-6c841b6785cd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.143462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b7608-1881-4c63-ad66-6c841b6785cd None admin] PATH_INFO: `/v3/users/bc74d33b575343409500f3f8dca19cca` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.148828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b7608-1881-4c63-ad66-6c841b6785cd None admin] RBAC: Authorizing `identity:get_user(user_id=bc74d33b575343409500f3f8dca19cca)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:00.150492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b7608-1881-4c63-ad66-6c841b6785cd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:00.152698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 87/176] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:21:59 2022] GET /identity/v3/users/bc74d33b575343409500f3f8dca19cca => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:00.162697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d745-bfdb-4819-8113-30666ed682be None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.162697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d745-bfdb-4819-8113-30666ed682be None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.162697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d745-bfdb-4819-8113-30666ed682be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.196669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8bb5d745-bfdb-4819-8113-30666ed682be None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:00.199050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8bb5d745-bfdb-4819-8113-30666ed682be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:00.290030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 88/177] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:00.298726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d745-bfdb-4819-8113-30666ed682be None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:00.301655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b983ec-41df-49cf-983b-041e1a6b2543 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:00.354619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aae172-a0cb-4e3b-bab3-47cfaf91d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:00.355728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aae172-a0cb-4e3b-bab3-47cfaf91d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.356341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aae172-a0cb-4e3b-bab3-47cfaf91d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.356809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aae172-a0cb-4e3b-bab3-47cfaf91d0c2 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.358286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aae172-a0cb-4e3b-bab3-47cfaf91d0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:00.360054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aae172-a0cb-4e3b-bab3-47cfaf91d0c2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:00.362300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 90/178] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:00 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:00.363798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dc356-9711-4479-89d4-3c757d4820fb None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.364376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dc356-9711-4479-89d4-3c757d4820fb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.364835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dc356-9711-4479-89d4-3c757d4820fb None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.366347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 91/179] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:00.368461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dc356-9711-4479-89d4-3c757d4820fb None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:00.431916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:00.452177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d745-bfdb-4819-8113-30666ed682be None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:00.489269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d679246-102b-41e1-9ce7-6f13849b6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:00.489912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d679246-102b-41e1-9ce7-6f13849b6cfc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.490189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d679246-102b-41e1-9ce7-6f13849b6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.490857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d679246-102b-41e1-9ce7-6f13849b6cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.502154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:00.521989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dc356-9711-4479-89d4-3c757d4820fb None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:00.562346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d6f80-f675-4885-a91a-c9756fd38ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:00.563331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d6f80-f675-4885-a91a-c9756fd38ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.563836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d6f80-f675-4885-a91a-c9756fd38ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.564294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d6f80-f675-4885-a91a-c9756fd38ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.565334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d6f80-f675-4885-a91a-c9756fd38ee6 None admin] RBAC: Adding query filter params (role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=bc74d33b575343409500f3f8dca19cca) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:00.566327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d6f80-f675-4885-a91a-c9756fd38ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:00.568035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d679246-102b-41e1-9ce7-6f13849b6cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:00.568426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d6f80-f675-4885-a91a-c9756fd38ee6 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:00.569556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d679246-102b-41e1-9ce7-6f13849b6cfc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:00.574663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 92/180] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:00 2022] GET /identity/v3/role_assignments?user.id=bc74d33b575343409500f3f8dca19cca&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:00.576016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013a46-904e-4ff4-a7ca-b5a6ae1aabdd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.576499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013a46-904e-4ff4-a7ca-b5a6ae1aabdd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.576962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013a46-904e-4ff4-a7ca-b5a6ae1aabdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.611966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-31013a46-904e-4ff4-a7ca-b5a6ae1aabdd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:00.616767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-31013a46-904e-4ff4-a7ca-b5a6ae1aabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:00.710136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 93/181] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:00.711516 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:00.719136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933712-17c6-4c13-84f8-51b98cf0a671 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.719451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933712-17c6-4c13-84f8-51b98cf0a671 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.720093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933712-17c6-4c13-84f8-51b98cf0a671 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.722070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 94/182] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:00.722857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af933712-17c6-4c13-84f8-51b98cf0a671 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:00.734696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 89/183] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:00.735879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5eb32-a6cf-4bdf-b4d7-43f3994ec5ef None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.736202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5eb32-a6cf-4bdf-b4d7-43f3994ec5ef None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.737182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5eb32-a6cf-4bdf-b4d7-43f3994ec5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.774821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-36e5eb32-a6cf-4bdf-b4d7-43f3994ec5ef None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:00.776048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-36e5eb32-a6cf-4bdf-b4d7-43f3994ec5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:00.846253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:00.881608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 90/184] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:00.885816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5eb32-a6cf-4bdf-b4d7-43f3994ec5ef None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:00.890717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af933712-17c6-4c13-84f8-51b98cf0a671 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:00.928305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:00.928943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:00.929212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:00.929472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:00.941551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:00.946801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:00.947690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:00.948487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 95/185] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:00.954545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.063013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd6c00-f6ae-4dc0-9fb4-158c3d574757 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.067601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5eb32-a6cf-4bdf-b4d7-43f3994ec5ef None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.086355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:01.096347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:01.105711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.106744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.107218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.107578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.108331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:01.109695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.111123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.116106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.117018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.117473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.117998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] PATH_INFO: `/v3/projects/2862a0717baf47d0aaa8e8ac7e928495` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.119285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] RBAC: Authorizing `identity:get_project(project_id=2862a0717baf47d0aaa8e8ac7e928495)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.120685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 96/186] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:01.121164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.121614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.123338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 91/187] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:00 2022] GET /identity/v3/projects/2862a0717baf47d0aaa8e8ac7e928495 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:01.126839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.253858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80364f-c78a-4e7d-a624-c1f45aa92576 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.254504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4444-8f54-44dd-83a6-0c4c2b281f65 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.291445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.292155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.292433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.292700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.293811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.294977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.295267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.295769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.296100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.296419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] PATH_INFO: `/v3/users/ecb99a7665324b38a137545a12e44a08` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.296838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 97/188] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:01.297583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.311687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] RBAC: Authorizing `identity:get_user(user_id=ecb99a7665324b38a137545a12e44a08)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.313508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.315806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 92/189] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:01 2022] GET /identity/v3/users/ecb99a7665324b38a137545a12e44a08 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:01.316730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.362581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:01.372345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:01.417614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec44a93-4202-443b-982c-211f73ed316c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.429553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af808c1b-414e-41a6-8c25-8eeed8fdef7e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.452226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5786-540d-4f2e-9577-332b721144af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.452841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5786-540d-4f2e-9577-332b721144af None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.453116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5786-540d-4f2e-9577-332b721144af None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.453387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5786-540d-4f2e-9577-332b721144af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.454373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f5786-540d-4f2e-9577-332b721144af None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=2862a0717baf47d0aaa8e8ac7e928495, user.id=bc74d33b575343409500f3f8dca19cca) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:01.454638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f5786-540d-4f2e-9577-332b721144af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.456032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f5786-540d-4f2e-9577-332b721144af None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.473826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 98/190] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:01 2022] GET /identity/v3/role_assignments?user.id=bc74d33b575343409500f3f8dca19cca&scope.project.id=2862a0717baf47d0aaa8e8ac7e928495&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:01.473826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5786-540d-4f2e-9577-332b721144af None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.477769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.479465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.479806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.496531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:01.503623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:01.504580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:01.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:01.506004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 93/191] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:01.506703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.590778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5786-540d-4f2e-9577-332b721144af None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.628892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:01.638329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:01.642833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa70f-38fc-44df-88e1-4d2768222540 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.643337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.643972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.644249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.644516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.645756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.647403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.675170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 99/192] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:01 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:01.676056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.698829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688b32c-cab8-4165-b0dd-ea1e7088b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.699820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b32c-cab8-4165-b0dd-ea1e7088b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.700597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b32c-cab8-4165-b0dd-ea1e7088b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.701064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b32c-cab8-4165-b0dd-ea1e7088b8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.785936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688b32c-cab8-4165-b0dd-ea1e7088b8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.787831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688b32c-cab8-4165-b0dd-ea1e7088b8f8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.841151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637131-2a6a-4d82-9867-c7c0974a9386 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:01.893441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95e614-19b8-4313-972f-560db71afc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:01.893441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95e614-19b8-4313-972f-560db71afc2b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.893441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95e614-19b8-4313-972f-560db71afc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.893441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95e614-19b8-4313-972f-560db71afc2b None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.894055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95e614-19b8-4313-972f-560db71afc2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:01.894055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95e614-19b8-4313-972f-560db71afc2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:01.894055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95e614-19b8-4313-972f-560db71afc2b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:01.903396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 100/193] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:01.904671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3b76d-6190-4af9-92f8-db17a66a5204 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.904948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3b76d-6190-4af9-92f8-db17a66a5204 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.905215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3b76d-6190-4af9-92f8-db17a66a5204 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.910691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 101/194] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:01.910691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3b76d-6190-4af9-92f8-db17a66a5204 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:01.929011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:01.934448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 94/195] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:01.935709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd78112-f486-427d-8e0e-9a74fd1fdd87 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:01.936666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd78112-f486-427d-8e0e-9a74fd1fdd87 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:01.936936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd78112-f486-427d-8e0e-9a74fd1fdd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:01.955595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fdd78112-f486-427d-8e0e-9a74fd1fdd87 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:01.956783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fdd78112-f486-427d-8e0e-9a74fd1fdd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:01.960354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:02.034171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3b76d-6190-4af9-92f8-db17a66a5204 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:02.036345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 95/196] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:02.037253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd78112-f486-427d-8e0e-9a74fd1fdd87 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.075315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:02.075945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:02.076217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:02.076479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] PATH_INFO: `/v3/users/ecb99a7665324b38a137545a12e44a08` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:02.078236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=ecb99a7665324b38a137545a12e44a08)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:02.080426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:02.082110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 102/197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:01 2022] GET /identity/v3/users/ecb99a7665324b38a137545a12e44a08 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:02.087722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.151882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd78112-f486-427d-8e0e-9a74fd1fdd87 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:02.182703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:02.199004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:02.200970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:02.201879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:02.202403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:02.204652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:02.206636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:02.209303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 96/198] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:02.223168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.247185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a52f16-a61a-4fb2-b12d-20c6aafb1ee2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:02.266564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:02.308241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:02.309377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:02.311073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:02.311536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:02.373233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d81cc-5cfe-4b5a-ad21-a8bec236aefc None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:02.388916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:02.391549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:02.411379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:02.412102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:02.412466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:02.412823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:02.414144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=ecb99a7665324b38a137545a12e44a08) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:02.414542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:02.416203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:02.425612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 97/199] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/role_assignments?user.id=ecb99a7665324b38a137545a12e44a08&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:02.426477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.534213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:02.554079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 103/200] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:02.558869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.580533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:02.611018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb19bb3-9aba-4638-bc90-072eb19a9bd7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:02.668904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:02.669467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:02.669739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:02.670029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:02.692862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:02.700230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:02.701164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:02.701983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:02.703429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 98/201] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:02.709182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.738178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2449a-5e3d-49c8-9429-25dc489cc99d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:02.818530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:02.819188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:02.819462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:02.819732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:02.820915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:02.822402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:02.824405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 104/202] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:02.830967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.864787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686ad5b-5f2a-411e-9157-b198a647567c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:02.902151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:02.934831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:02.935355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:02.935624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:02.935889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:02.936557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:02.936857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:02.944245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:02.964625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 99/203] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:02.966643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:02.972619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:03.014529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8e462-e964-41b6-a1ac-d39ca7dd5c47 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:03.074000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:03.074609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:03.074881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:03.075145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:03.075865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] RBAC: Adding query filter params (role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=ecb99a7665324b38a137545a12e44a08) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:03.076164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:03.077598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:03.088337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/role_assignments?user.id=ecb99a7665324b38a137545a12e44a08&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:03.122739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b493cfe-d732-4734-be3d-47fbdf1e65e3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:03.176908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:03.177541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:03.177814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:03.178098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] PATH_INFO: `/v3/users/cc12a26f5d534c8597389e96ca614ed4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:03.179229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] RBAC: Authorizing `identity:get_user(user_id=cc12a26f5d534c8597389e96ca614ed4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:03.180686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:03.182501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 100/205] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:02 2022] GET /identity/v3/users/cc12a26f5d534c8597389e96ca614ed4 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:03.188370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:03.295974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d071be-e533-4046-92fd-98e8d33be94c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:03.331083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:03.331709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:03.332032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:03.332294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:03.349976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:03.421865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:03.423516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:03.530417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 106/206] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:03.536558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:03.627194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:03.703741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c65d9-cea8-43da-b47f-5092113e2628 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:03.736956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50a147-9bd7-4550-b55b-be7f6b243438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:03.737593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50a147-9bd7-4550-b55b-be7f6b243438 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:03.737964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50a147-9bd7-4550-b55b-be7f6b243438 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:03.738231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50a147-9bd7-4550-b55b-be7f6b243438 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:03.739356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50a147-9bd7-4550-b55b-be7f6b243438 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:03.740874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50a147-9bd7-4550-b55b-be7f6b243438 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:03.746349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:03 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:03.748853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:03.822239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:03.892598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d908c60-45dc-4093-b100-9307e46dec13 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:03.940162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8087a3-0e59-4cb0-8489-882bc5bb9a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:03.940784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8087a3-0e59-4cb0-8489-882bc5bb9a59 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:03.941060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8087a3-0e59-4cb0-8489-882bc5bb9a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:03.941330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8087a3-0e59-4cb0-8489-882bc5bb9a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:03.942091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8087a3-0e59-4cb0-8489-882bc5bb9a59 None admin] RBAC: Adding query filter params (role.id=4c0caecb94cb472ab6c1d958b8af8df9, scope.project.id=b5d6f4402df346168c2f6561120c3c31, user.id=cc12a26f5d534c8597389e96ca614ed4) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:03.942396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8087a3-0e59-4cb0-8489-882bc5bb9a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:03.943862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8087a3-0e59-4cb0-8489-882bc5bb9a59 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:03.950397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:03 2022] GET /identity/v3/role_assignments?user.id=cc12a26f5d534c8597389e96ca614ed4&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=4c0caecb94cb472ab6c1d958b8af8df9 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:04.453786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50be24-1a6b-48b5-813b-b51fba697ed2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:04.454973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50be24-1a6b-48b5-813b-b51fba697ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:04.455439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50be24-1a6b-48b5-813b-b51fba697ed2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:04.457280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 102/209] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:04.462491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721313-50a0-4ea3-916e-5a9e162e4fa9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:04.463306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721313-50a0-4ea3-916e-5a9e162e4fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:04.463789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721313-50a0-4ea3-916e-5a9e162e4fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:04.484202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-53721313-50a0-4ea3-916e-5a9e162e4fa9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:04.485779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-53721313-50a0-4ea3-916e-5a9e162e4fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:04.503422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc29df-85df-44f4-b207-453342b659a7 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:04.504002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc29df-85df-44f4-b207-453342b659a7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:04.504514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc29df-85df-44f4-b207-453342b659a7 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:04.506065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 103/210] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:04.511516 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf1f50-824a-42af-b95d-19a85fcbd12b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:04.512032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf1f50-824a-42af-b95d-19a85fcbd12b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:04.512509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf1f50-824a-42af-b95d-19a85fcbd12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:04.535774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4cdf1f50-824a-42af-b95d-19a85fcbd12b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:04.537256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4cdf1f50-824a-42af-b95d-19a85fcbd12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:04.570908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 108/211] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:04.625828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 104/212] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:04.864876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721313-50a0-4ea3-916e-5a9e162e4fa9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:04.897760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf1f50-824a-42af-b95d-19a85fcbd12b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:04.901775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:04.962061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:04.996697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721313-50a0-4ea3-916e-5a9e162e4fa9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.029003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf1f50-824a-42af-b95d-19a85fcbd12b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.035718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:05.036372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.036649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.036919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.049249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:05.054227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:05.055114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:05.055911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 109/213] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:05.062756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:05.075333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:05.076021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.076298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.076563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.077668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:05.079196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:05.080787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 105/214] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:05.086403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:05.166492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:05.176716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39deb9-161c-4920-9600-ee43bd274507 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.191095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c318c-9858-48a3-96ef-b30c57c34372 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.208105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:05.212039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb5932-b0be-4f8b-8792-a435ab18fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:05.212678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb5932-b0be-4f8b-8792-a435ab18fdfc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.212941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb5932-b0be-4f8b-8792-a435ab18fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.213207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb5932-b0be-4f8b-8792-a435ab18fdfc None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.213900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb5932-b0be-4f8b-8792-a435ab18fdfc None admin] RBAC: Adding query filter params (name=member) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:05.214199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb5932-b0be-4f8b-8792-a435ab18fdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:05.215576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb5932-b0be-4f8b-8792-a435ab18fdfc None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:05.224171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 110/215] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:05.228271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed9bd9-fe5b-41cf-87a7-f7c63800f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:05.229018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed9bd9-fe5b-41cf-87a7-f7c63800f8a0 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.229293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed9bd9-fe5b-41cf-87a7-f7c63800f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.229554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed9bd9-fe5b-41cf-87a7-f7c63800f8a0 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.229899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281085fd-fe49-4253-a271-5cc9afb67fa6 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.230187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281085fd-fe49-4253-a271-5cc9afb67fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.230282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed9bd9-fe5b-41cf-87a7-f7c63800f8a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:05.230470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281085fd-fe49-4253-a271-5cc9afb67fa6 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.231838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed9bd9-fe5b-41cf-87a7-f7c63800f8a0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:05.231938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 111/216] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:05.232404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281085fd-fe49-4253-a271-5cc9afb67fa6 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:05.265851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 106/217] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:05 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:05.265851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a594c1-21a9-423c-8f43-a1e8fc228b78 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.265851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a594c1-21a9-423c-8f43-a1e8fc228b78 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.265851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a594c1-21a9-423c-8f43-a1e8fc228b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.287300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-23a594c1-21a9-423c-8f43-a1e8fc228b78 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:05.288893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23a594c1-21a9-423c-8f43-a1e8fc228b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:05.363348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281085fd-fe49-4253-a271-5cc9afb67fa6 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.389304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 107/218] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:05.417405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:05.417997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.418321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.418589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] PATH_INFO: `/v3/users/3fe62f094be6496690b45a2d60638738` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.434550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=3fe62f094be6496690b45a2d60638738)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:05.436035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:05.438081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 112/219] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:05 2022] GET /identity/v3/users/3fe62f094be6496690b45a2d60638738 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:05.443975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a594c1-21a9-423c-8f43-a1e8fc228b78 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:05.551349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a594c1-21a9-423c-8f43-a1e8fc228b78 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.554237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:05.594983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc42194-9e33-41ba-818a-13993999e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:05.595622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42194-9e33-41ba-818a-13993999e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.595893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42194-9e33-41ba-818a-13993999e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.596163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42194-9e33-41ba-818a-13993999e5a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.674187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:05.674945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc42194-9e33-41ba-818a-13993999e5a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:05.677441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc42194-9e33-41ba-818a-13993999e5a1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:05.702510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:05.814179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a81217-6d6a-4d1d-875f-f3b84be64fc8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.815407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 108/220] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:05.817975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905c1b-1e9d-4107-a47e-5c2607aa58f3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.818407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905c1b-1e9d-4107-a47e-5c2607aa58f3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.819144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905c1b-1e9d-4107-a47e-5c2607aa58f3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.820567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 109/221] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:05.823318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a905c1b-1e9d-4107-a47e-5c2607aa58f3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:05.828347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:05.859443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28aef49-03a1-4be9-bbf0-12845b340795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:05.860107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aef49-03a1-4be9-bbf0-12845b340795 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.860422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aef49-03a1-4be9-bbf0-12845b340795 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.860686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aef49-03a1-4be9-bbf0-12845b340795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.871596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28aef49-03a1-4be9-bbf0-12845b340795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-a28aef49-03a1-4be9-bbf0-12845b340795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:05.876719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:05.877651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:05.878496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 113/222] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:05.883791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218256-21b1-4b13-84fd-a797a5fa90cc None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:05.883791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218256-21b1-4b13-84fd-a797a5fa90cc None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:05.883791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218256-21b1-4b13-84fd-a797a5fa90cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:05.900310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-eb218256-21b1-4b13-84fd-a797a5fa90cc None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:05.901588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-eb218256-21b1-4b13-84fd-a797a5fa90cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:05.967078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a905c1b-1e9d-4107-a47e-5c2607aa58f3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:05.973867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 114/223] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:05.975015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb218256-21b1-4b13-84fd-a797a5fa90cc None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:05.984584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:06.014451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.015492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.016758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.017178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.018520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.020163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.022770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 110/224] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:05 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:06.028743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.099928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb218256-21b1-4b13-84fd-a797a5fa90cc None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.123263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:06.140668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.141904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.142346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.142620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.143293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:06.143593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.144975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.155619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 115/225] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:06.161328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.192306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3fa53-9cf6-4e3d-95cc-28ab74944e6d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.266273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:06.283515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.284536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.285023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.285480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.286435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=3fe62f094be6496690b45a2d60638738) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:06.286938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.288954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.299827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:06 2022] GET /identity/v3/role_assignments?user.id=3fe62f094be6496690b45a2d60638738&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:06.300512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.305932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26e667-5c08-4d78-87ab-a649654ff793 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.355855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.356913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.357190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.357456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] PATH_INFO: `/v3/users/ecb99a7665324b38a137545a12e44a08` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.358684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] RBAC: Authorizing `identity:get_user(user_id=ecb99a7665324b38a137545a12e44a08)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.360933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.363559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 116/227] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:06 2022] GET /identity/v3/users/ecb99a7665324b38a137545a12e44a08 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:06.369339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.423946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a88686-b421-4fe5-b24c-8372a6635e16 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.510656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.511315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.511875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.512147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.521258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:06.535834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd6683-f8f0-4f7a-bea2-6a2378d1ae4f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.554517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:06.560697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:06.561596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:06.562419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 112/228] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:06.570638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.581040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.581708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.582002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.582267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.585499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.587235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.589596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:06 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:06.595789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.601929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:06.683183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbedb0-c162-40be-a2d8-3c30f1b705d8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.709422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afe0db-200c-4214-acf4-e0b023821371 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.716995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.717614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.717923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.718191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.718858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:06.719148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.720605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.728802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 113/230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:06.734291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.749241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.750799 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.751272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.751820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/ecb99a7665324b38a137545a12e44a08/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.754115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5bc1312f843f487f7007653e1718f, user_id=ecb99a7665324b38a137545a12e44a08, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.755952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.784274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 118/231] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:06 2022] PUT /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/ecb99a7665324b38a137545a12e44a08/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:22:06.795263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:06.848818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf4ef-fdd8-42c1-9608-918088c5e401 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:06.896055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:06.896706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:06.896980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:06.897248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] PATH_INFO: `/v3/users/ecb99a7665324b38a137545a12e44a08` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:06.898497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] RBAC: Authorizing `identity:get_user(user_id=ecb99a7665324b38a137545a12e44a08)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:06.899998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:06.902034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 114/232] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:06 2022] GET /identity/v3/users/ecb99a7665324b38a137545a12e44a08 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:06.908030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:06.998986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:07.044534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c842-229b-4666-9634-be603c8066e4 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:07.079144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31929f3-04b2-464c-860d-2e08fb854250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:07.079800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31929f3-04b2-464c-860d-2e08fb854250 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:07.080070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31929f3-04b2-464c-860d-2e08fb854250 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:07.080333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31929f3-04b2-464c-860d-2e08fb854250 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:07.081471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31929f3-04b2-464c-860d-2e08fb854250 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:07.082949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31929f3-04b2-464c-860d-2e08fb854250 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:07.084766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 119/233] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:06 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:07.090407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:07.200464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b172a96-5014-4cb4-9a18-c1d3cd80aa26 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:07.235317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:07.242642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da153a-e396-4759-a42e-3d631270ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:07.243546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da153a-e396-4759-a42e-3d631270ad3f None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:07.244035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da153a-e396-4759-a42e-3d631270ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:07.244594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da153a-e396-4759-a42e-3d631270ad3f None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/ecb99a7665324b38a137545a12e44a08/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:07.248014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da153a-e396-4759-a42e-3d631270ad3f None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5bc1312f843f487f7007653e1718f, user_id=ecb99a7665324b38a137545a12e44a08, role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:07.249808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da153a-e396-4759-a42e-3d631270ad3f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:07.267016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 115/234] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:07 2022] PUT /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/ecb99a7665324b38a137545a12e44a08/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:08.155847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36629f9-2800-44e9-85ab-46021c715349 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:08.156383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36629f9-2800-44e9-85ab-46021c715349 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:08.156383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36629f9-2800-44e9-85ab-46021c715349 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:08.158135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 120/235] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:08.162737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a869cb9-3d0f-4a1a-86cf-20a2bf9f7d9b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:08.163250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a869cb9-3d0f-4a1a-86cf-20a2bf9f7d9b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:08.164079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a869cb9-3d0f-4a1a-86cf-20a2bf9f7d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:08.167783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de22f7-b340-4444-b567-5f02dda8bc0f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:08.168928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de22f7-b340-4444-b567-5f02dda8bc0f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:08.169940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de22f7-b340-4444-b567-5f02dda8bc0f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:08.172485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 116/236] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:08.180255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e57e-835e-4eac-b948-d7cd4aeaa429 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:08.185571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e57e-835e-4eac-b948-d7cd4aeaa429 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:08.186086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e57e-835e-4eac-b948-d7cd4aeaa429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:08.202999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2a869cb9-3d0f-4a1a-86cf-20a2bf9f7d9b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:08.204254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2a869cb9-3d0f-4a1a-86cf-20a2bf9f7d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:08.217664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e0f4e57e-835e-4eac-b948-d7cd4aeaa429 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:08.218875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e0f4e57e-835e-4eac-b948-d7cd4aeaa429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:08.325619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 121/237] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:08.343920 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 117/238] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:08.655429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a869cb9-3d0f-4a1a-86cf-20a2bf9f7d9b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:08.680749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e57e-835e-4eac-b948-d7cd4aeaa429 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:08.753595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:08.823968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a869cb9-3d0f-4a1a-86cf-20a2bf9f7d9b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:08.861536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e57e-835e-4eac-b948-d7cd4aeaa429 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:08.873569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:08.874164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:08.874433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:08.874697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:08.877965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:08.878495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:08.880079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:08.885830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 122/239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:08.895262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:08.906243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:08.907227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:08.907673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:08.908110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:08.927703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:08.935313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:08.936190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:08.936978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 118/240] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:08.945988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:09.051456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c749b6-691f-43dc-9433-359a986f3f04 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:09.082577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:09.091584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003cfd0-3469-4e4c-8424-f9ea36c42457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:09.092200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003cfd0-3469-4e4c-8424-f9ea36c42457 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.093828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003cfd0-3469-4e4c-8424-f9ea36c42457 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.094382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003cfd0-3469-4e4c-8424-f9ea36c42457 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.095116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003cfd0-3469-4e4c-8424-f9ea36c42457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:09.096634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003cfd0-3469-4e4c-8424-f9ea36c42457 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:09.142380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 123/241] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:08 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:09.144352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdedc-3b38-4729-8548-7de5347ddb2c None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.144932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdedc-3b38-4729-8548-7de5347ddb2c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.145210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdedc-3b38-4729-8548-7de5347ddb2c None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.147589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 124/242] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:09.153567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d87c-9dff-4826-ad03-d389a087329b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.153889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d87c-9dff-4826-ad03-d389a087329b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.154135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d87c-9dff-4826-ad03-d389a087329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.175307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7fa4d87c-9dff-4826-ad03-d389a087329b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:09.176816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7fa4d87c-9dff-4826-ad03-d389a087329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:09.178142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946e3a-6436-4267-9f31-6f0e696389a2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:09.240173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:09.240794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.241062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.241387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.242075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:09.242457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:09.243872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:09.262738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 119/243] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:09.268206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 125/244] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:09.270502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:09.332867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:09.389939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1067e-173a-457e-b40d-bace1ea7abf4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:09.439390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159bc98-ec8c-4de1-bf55-eea75db1a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:09.439964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159bc98-ec8c-4de1-bf55-eea75db1a14b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.440231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159bc98-ec8c-4de1-bf55-eea75db1a14b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.440496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159bc98-ec8c-4de1-bf55-eea75db1a14b None admin] PATH_INFO: `/v3/users/ae4259584b454a8282cd4416e3b704ac` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.456586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159bc98-ec8c-4de1-bf55-eea75db1a14b None admin] RBAC: Authorizing `identity:get_user(user_id=ae4259584b454a8282cd4416e3b704ac)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:09.458117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159bc98-ec8c-4de1-bf55-eea75db1a14b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:09.460238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 120/245] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:09 2022] GET /identity/v3/users/ae4259584b454a8282cd4416e3b704ac => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:09.465879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d87c-9dff-4826-ad03-d389a087329b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:09.486502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0432-3d83-4422-8dec-6dd24f79a3b6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.486834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0432-3d83-4422-8dec-6dd24f79a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.487026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0432-3d83-4422-8dec-6dd24f79a3b6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.488381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 121/246] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:09.494976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ecaa-a4fb-4a3d-a482-48af402db7f9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.495247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ecaa-a4fb-4a3d-a482-48af402db7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.495509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ecaa-a4fb-4a3d-a482-48af402db7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.523761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cc19ecaa-a4fb-4a3d-a482-48af402db7f9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:09.525410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cc19ecaa-a4fb-4a3d-a482-48af402db7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:09.592422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d87c-9dff-4826-ad03-d389a087329b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:09.599108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 122/247] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:09.620848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:09.640117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:09.640730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.640996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.641285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.654499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ecaa-a4fb-4a3d-a482-48af402db7f9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:09.685693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:09.727581 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:09.729955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:09.784376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ecaa-a4fb-4a3d-a482-48af402db7f9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:09.832103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:09.832320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:09.832559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:09.832823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:09.847205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:09.853155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:09.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:09.854885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 123/248] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:09.861042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:09.867060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 126/249] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:09.874179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:09.892153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:09.969550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:09.991903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c150faa-f786-4e83-8695-23cf3a39a715 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:09.999230 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10f3eb-fb7d-4de9-b658-bfce9e5de9a3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.034062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.034693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.034957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.035222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.035878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:10.036175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.037576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.046667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683775a9-97e7-4b2e-89e7-e8c0ebfddb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.047315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683775a9-97e7-4b2e-89e7-e8c0ebfddb5e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.047667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683775a9-97e7-4b2e-89e7-e8c0ebfddb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.047944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683775a9-97e7-4b2e-89e7-e8c0ebfddb5e None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.048182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 124/250] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:10.049140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.049342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683775a9-97e7-4b2e-89e7-e8c0ebfddb5e None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.050836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683775a9-97e7-4b2e-89e7-e8c0ebfddb5e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.053979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 127/251] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:09 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:10.055182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ec16-b24e-4315-83e7-342dd8e35424 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.055465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ec16-b24e-4315-83e7-342dd8e35424 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.055737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ec16-b24e-4315-83e7-342dd8e35424 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.057200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 128/252] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:10.057931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63ec16-b24e-4315-83e7-342dd8e35424 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.159457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d504c9-339e-47b6-b84a-f135e92ff7ba None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.192559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63ec16-b24e-4315-83e7-342dd8e35424 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.194513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:10.195258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.196007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.196508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.196973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.208410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:10.214290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:10.215245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:10.216033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 125/253] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:10.216775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.232465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:10.237035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b1c69-5bd3-421d-9235-a5f7251fd37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.237844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1c69-5bd3-421d-9235-a5f7251fd37f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.238374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1c69-5bd3-421d-9235-a5f7251fd37f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.238787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1c69-5bd3-421d-9235-a5f7251fd37f None admin] PATH_INFO: `/v3/users/3fe62f094be6496690b45a2d60638738` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.240198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b1c69-5bd3-421d-9235-a5f7251fd37f None admin] RBAC: Authorizing `identity:get_user(user_id=3fe62f094be6496690b45a2d60638738)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.241999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b1c69-5bd3-421d-9235-a5f7251fd37f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.243869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 129/254] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/users/3fe62f094be6496690b45a2d60638738 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:10.245148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba3399-a873-467b-bc6f-040ba46dcca3 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.245511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba3399-a873-467b-bc6f-040ba46dcca3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.245891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba3399-a873-467b-bc6f-040ba46dcca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.265442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d2ba3399-a873-467b-bc6f-040ba46dcca3 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:10.266911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d2ba3399-a873-467b-bc6f-040ba46dcca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:10.339852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 130/255] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:10.340931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba3399-a873-467b-bc6f-040ba46dcca3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.349072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f2fd-d126-4aab-abb6-c43c33f32fd4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.384531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.385168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.385441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.385705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.386461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] RBAC: Adding query filter params (role.id=4c0caecb94cb472ab6c1d958b8af8df9, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=ae4259584b454a8282cd4416e3b704ac) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:10.386761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.388360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.394298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 126/256] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/role_assignments?user.id=ae4259584b454a8282cd4416e3b704ac&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=4c0caecb94cb472ab6c1d958b8af8df9 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:10.395140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.456260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:10.490073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:10.498101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba3399-a873-467b-bc6f-040ba46dcca3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.547950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6ea0-023e-4c26-a274-04882c0c688a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.565085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.565758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.566053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.566315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.566994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:10.567271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.571498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.590038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 131/257] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:10.596306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.631953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.632829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.633104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.634942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.636320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.637816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.641271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 127/258] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:10.647837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.756007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb2784-3188-47f6-8d49-5a88c3651452 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.795903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.796544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.796816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.797081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] PATH_INFO: `/v3/users/ecb99a7665324b38a137545a12e44a08` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.799771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] RBAC: Authorizing `identity:get_user(user_id=ecb99a7665324b38a137545a12e44a08)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.802215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.809837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 132/259] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/users/ecb99a7665324b38a137545a12e44a08 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:10.811185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.813858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6ab2-5019-49a5-93b7-ae121ab6103c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:10.828448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:10.873188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:10.873890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:10.874170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:10.876075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/3fe62f094be6496690b45a2d60638738/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:10.878251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5bc1312f843f487f7007653e1718f, user_id=3fe62f094be6496690b45a2d60638738, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:10.879728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:10.897744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:10.905289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 128/260] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:10 2022] PUT /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/3fe62f094be6496690b45a2d60638738/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:10.906406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:10.998125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819e5d1-8335-4d4e-9362-c70ba87c0ddf None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:11.075817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:11.076468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:11.076740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:11.077007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:11.099303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:11.108521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:11.109454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:11.110334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:11.115389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 133/261] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:11.118329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592eb88-a52d-49c3-8fd9-1dc6fca49c88 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:11.125994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:11.200941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:11.201636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:11.201864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:11.202130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:11.257887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:11.295985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32541238-733a-42b6-8413-b58adb9f3573 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:11.349303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:11.349858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:11.350135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:11.350404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:11.351068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:11.351362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:11.352756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:11.354010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:11.357765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:11.359361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:11.375430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 134/262] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:11.389662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:11.551062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 129/263] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:11.564804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:11.583850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afb412-6b24-4fe0-b279-51059200a237 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:11.646523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:11.647272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:11.647553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:11.647823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] PATH_INFO: `/v3/users/ecb99a7665324b38a137545a12e44a08` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:11.650187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] RBAC: Authorizing `identity:get_user(user_id=ecb99a7665324b38a137545a12e44a08)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:11.651636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:11.653775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 135/264] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:11 2022] GET /identity/v3/users/ecb99a7665324b38a137545a12e44a08 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:11.659933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:11.666092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:11.746182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:11.771745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b34022-802e-4915-a9e4-d4a1007d0ee8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:11.812742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4c871-2856-4542-8b23-e711f16b5f6e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:11.869528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:11.870175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:11.870505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:11.870708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:11.874533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:11.875394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:11.876056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:11.876526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:11.882533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:11.884264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:11.886515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 130/265] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:11 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:11.894782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:11.974966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:11.976551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:12.003439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:12.117821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 136/266] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:12.119079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:12.191900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4a9c-a8ec-4f4b-85d6-ab8098b17c67 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:12.261420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:12.262111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:12.262364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:12.262633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:12.263365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=ecb99a7665324b38a137545a12e44a08) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:12.263670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:12.265119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:12.266715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcce38-c425-41d5-b776-742259eb0d82 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:12.282165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:12.284284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 131/267] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:11 2022] GET /identity/v3/role_assignments?user.id=ecb99a7665324b38a137545a12e44a08&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:12.329574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996592c6-2516-48de-8093-d1775c5730af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:12.330271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996592c6-2516-48de-8093-d1775c5730af None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:12.330545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996592c6-2516-48de-8093-d1775c5730af None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:12.330809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996592c6-2516-48de-8093-d1775c5730af None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:12.334676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996592c6-2516-48de-8093-d1775c5730af None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:12.336174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996592c6-2516-48de-8093-d1775c5730af None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:12.338032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 137/268] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:12 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:12.344257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:12.400282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:12.504415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b412d-4871-45d8-8c2c-964732babf18 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:12.540749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11001d-9ae7-4caf-8d1b-f3d3d451f599 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:12.541092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11001d-9ae7-4caf-8d1b-f3d3d451f599 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:12.541287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11001d-9ae7-4caf-8d1b-f3d3d451f599 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:12.542688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 138/269] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:12.549726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87730-9a7c-4f5f-aba6-eae59ddc7dd2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:12.550038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87730-9a7c-4f5f-aba6-eae59ddc7dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:12.550310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87730-9a7c-4f5f-aba6-eae59ddc7dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:12.566219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cc7d6-ae6a-4369-b99c-95ef515d4c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:12.567156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cc7d6-ae6a-4369-b99c-95ef515d4c54 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:12.567624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cc7d6-ae6a-4369-b99c-95ef515d4c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:12.568060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cc7d6-ae6a-4369-b99c-95ef515d4c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:12.569046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cc7d6-ae6a-4369-b99c-95ef515d4c54 None admin] RBAC: Adding query filter params (role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=ecb99a7665324b38a137545a12e44a08) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:12.569522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cc7d6-ae6a-4369-b99c-95ef515d4c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:12.571192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cc7d6-ae6a-4369-b99c-95ef515d4c54 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:12.578692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a1f87730-9a7c-4f5f-aba6-eae59ddc7dd2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:12.581376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a1f87730-9a7c-4f5f-aba6-eae59ddc7dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:12.586023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 132/270] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:12 2022] GET /identity/v3/role_assignments?user.id=ecb99a7665324b38a137545a12e44a08&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:12.682293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 139/271] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:12.857757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5acf-4a7f-462d-a409-b1b6f540e7b3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:12.858527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5acf-4a7f-462d-a409-b1b6f540e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:12.859096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5acf-4a7f-462d-a409-b1b6f540e7b3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:12.861588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 133/272] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:12.867699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36633a71-49d9-434b-b768-7ec11fda3932 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:12.868238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36633a71-49d9-434b-b768-7ec11fda3932 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:12.868704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36633a71-49d9-434b-b768-7ec11fda3932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:12.889574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-36633a71-49d9-434b-b768-7ec11fda3932 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:12.891202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-36633a71-49d9-434b-b768-7ec11fda3932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:12.976346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 140/273] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:13.043267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f5acf-4a7f-462d-a409-b1b6f540e7b3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:13.160097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:13.168925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f5acf-4a7f-462d-a409-b1b6f540e7b3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:13.211566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:13.212457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.212876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.213331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.231937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:13.238204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:13.239352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:13.240384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:13.243735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 134/274] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:13.249366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36633a71-49d9-434b-b768-7ec11fda3932 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:13.289111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:13.318075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:13.377075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36633a71-49d9-434b-b768-7ec11fda3932 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:13.422253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:13.422852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.423382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.423484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.424161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] RBAC: Adding query filter params (name=member) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:13.424472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:13.424767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6274-d95f-4b15-b83c-a7936311dafc None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:13.425938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:13.440886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 141/275] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:13.447232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:13.470967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:13.471850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.472223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.472584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.473878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:13.475499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:13.481932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 135/276] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:13.483234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:13.526204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:13.555605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:13.566463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a17e3-0f18-42ad-885d-acef7e678729 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:13.601760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b176a-cb07-4540-b987-27fd6507af79 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:13.602562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c9f4-62ee-415c-a4ec-701b629241da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:13.603224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c9f4-62ee-415c-a4ec-701b629241da None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.603495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c9f4-62ee-415c-a4ec-701b629241da None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.603759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c9f4-62ee-415c-a4ec-701b629241da None admin] PATH_INFO: `/v3/users/6a6295aca67f41a695783e51d007aefd` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.619395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38c9f4-62ee-415c-a4ec-701b629241da None admin] RBAC: Authorizing `identity:get_user(user_id=6a6295aca67f41a695783e51d007aefd)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:13.620930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38c9f4-62ee-415c-a4ec-701b629241da None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:13.627499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 142/277] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:13 2022] GET /identity/v3/users/6a6295aca67f41a695783e51d007aefd => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:13.627499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9344e7-a176-4dbd-b021-bb2a4d1f7f7d None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.627499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9344e7-a176-4dbd-b021-bb2a4d1f7f7d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.627499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9344e7-a176-4dbd-b021-bb2a4d1f7f7d None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.627499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 143/278] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:13.628470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9344e7-a176-4dbd-b021-bb2a4d1f7f7d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:13.648519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778002c5-caac-47e2-b97d-e84ee784356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:13.649152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778002c5-caac-47e2-b97d-e84ee784356b None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.649423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778002c5-caac-47e2-b97d-e84ee784356b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.649686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778002c5-caac-47e2-b97d-e84ee784356b None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.650393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778002c5-caac-47e2-b97d-e84ee784356b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:13.651890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778002c5-caac-47e2-b97d-e84ee784356b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:13.675726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 136/279] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:13 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:22:13.677380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e3f26-2a1e-4e12-97c9-8d73028a98f2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.677898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e3f26-2a1e-4e12-97c9-8d73028a98f2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.678360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e3f26-2a1e-4e12-97c9-8d73028a98f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.704247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-859e3f26-2a1e-4e12-97c9-8d73028a98f2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:13.706043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-859e3f26-2a1e-4e12-97c9-8d73028a98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:13.752106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9344e7-a176-4dbd-b021-bb2a4d1f7f7d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:13.786086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 137/280] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:13.787738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c08c-890b-48cc-a27f-dab30dab449e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.788015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c08c-890b-48cc-a27f-dab30dab449e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.788389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c08c-890b-48cc-a27f-dab30dab449e None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.790239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:13.790359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 138/281] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:13.793848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.793848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.793848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.793848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, user.id=6a6295aca67f41a695783e51d007aefd, scope.system=all) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:13.793848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:13.793848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:13.799940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 144/282] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 30 09:22:13 2022] GET /identity/v3/role_assignments?user.id=6a6295aca67f41a695783e51d007aefd&scope.system=all&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:13.803350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a43b8-7ec6-4c25-9538-fea584babb05 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:13.803951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a43b8-7ec6-4c25-9538-fea584babb05 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:13.804433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a43b8-7ec6-4c25-9538-fea584babb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:13.826407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8e9a43b8-7ec6-4c25-9538-fea584babb05 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:13.828176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8e9a43b8-7ec6-4c25-9538-fea584babb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:13.831236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:13.912477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 139/283] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:14.065526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.082633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:14.179674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a43b8-7ec6-4c25-9538-fea584babb05 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.182478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ba66-68a1-4778-830f-028db3683d0e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:14.218168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:14.218813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:14.219086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:14.225161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:14.230184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:14.235789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:14.236851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:14.238175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 145/284] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:14.247098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.306457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a43b8-7ec6-4c25-9538-fea584babb05 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:14.370604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:14.371213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:14.371440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:14.371684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:14.374849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:14.394418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:14.398065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:14.400673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8704c-7ef2-4220-bfe3-3641793bd6e0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:14.406734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:14.408057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:14.408870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 140/285] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:14.418812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.436836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:14.437457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:14.437730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:14.438079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:14.438816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:14.439116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:14.440520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:14.449527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 146/286] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:14.455528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.596635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44f5d0-6399-4e50-9e69-f672a838b66d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:14.616795 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be3a9f-be13-4148-8e64-b4aa446c1413 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:14.650603 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:14.651306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:14.651578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:14.651841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:14.652504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:14.652790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:14.654217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:14.663910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 141/287] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:14.673459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.694525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:14.695436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:14.695877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:14.696293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] PATH_INFO: `/v3/users/ae4259584b454a8282cd4416e3b704ac` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:14.697720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4259584b454a8282cd4416e3b704ac)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:14.699390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:14.701490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 147/288] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/users/ae4259584b454a8282cd4416e3b704ac => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:14.706640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.714926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:14.741421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:14.785046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b64be-d9ce-4e0c-8319-ce19f0e699a1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:14.820942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:14.822025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:14.822490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:14.823031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] PATH_INFO: `/v3/users/3fe62f094be6496690b45a2d60638738` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:14.824361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] RBAC: Authorizing `identity:get_user(user_id=3fe62f094be6496690b45a2d60638738)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:14.826132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:14.828326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 142/289] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/users/3fe62f094be6496690b45a2d60638738 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:14.833590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:14.918819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa390d0-afab-4e89-b826-c93444499f99 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:14.999444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09288e8-9ee3-4a2d-b1cb-eea6903d2c9f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:15.015276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:15.015910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:15.016308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:15.016496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:15.022482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:15.023951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:15.026010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 148/290] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:15.028904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:15.031317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:15.040674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:15.041674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:15.042194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:15.042650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:15.116927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:15.118898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:15.199821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:15.228882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 143/291] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:15.234716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:15.262672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067b6c-c713-4f22-ae66-c38e9807e614 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:15.280571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:15.347111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:15.347720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:15.347991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:15.348260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/ae4259584b454a8282cd4416e3b704ac/roles/4c0caecb94cb472ab6c1d958b8af8df9` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:15.355223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5bc1312f843f487f7007653e1718f, user_id=ae4259584b454a8282cd4416e3b704ac, role_id=4c0caecb94cb472ab6c1d958b8af8df9)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:15.356215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61db65-b127-4285-9618-28f1a187c433 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:15.356699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:15.391833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1696f-9383-420d-b9db-64ff6f23853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:15.392366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 149/292] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:15 2022] PUT /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f/users/ae4259584b454a8282cd4416e3b704ac/roles/4c0caecb94cb472ab6c1d958b8af8df9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:22:15.393544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1696f-9383-420d-b9db-64ff6f23853e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:15.394074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1696f-9383-420d-b9db-64ff6f23853e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:15.394581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1696f-9383-420d-b9db-64ff6f23853e None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:15.396181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1696f-9383-420d-b9db-64ff6f23853e None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:15.397963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1696f-9383-420d-b9db-64ff6f23853e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:15.400056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 144/293] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:15 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:15.415081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:15.565446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca86a-1fe2-4498-9b2a-44fbcaa3d962 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:15.611164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:15.628243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069738-caf8-48f5-86a0-d19d78a731f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:15.628877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069738-caf8-48f5-86a0-d19d78a731f8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:15.629147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069738-caf8-48f5-86a0-d19d78a731f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:15.629411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069738-caf8-48f5-86a0-d19d78a731f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:15.630171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069738-caf8-48f5-86a0-d19d78a731f8 None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=3fe62f094be6496690b45a2d60638738) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:15.630497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069738-caf8-48f5-86a0-d19d78a731f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:15.631939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069738-caf8-48f5-86a0-d19d78a731f8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:15.638670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 150/294] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:15 2022] GET /identity/v3/role_assignments?user.id=3fe62f094be6496690b45a2d60638738&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:16.397854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf517-28e5-4664-b57f-10eaf1989eb6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:16.398389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf517-28e5-4664-b57f-10eaf1989eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:16.398665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf517-28e5-4664-b57f-10eaf1989eb6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:16.400813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 145/295] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:16.406948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bff651-5fc8-4352-a96e-ec9f8206a17b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:16.407449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bff651-5fc8-4352-a96e-ec9f8206a17b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:16.407555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bff651-5fc8-4352-a96e-ec9f8206a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:16.429651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-64bff651-5fc8-4352-a96e-ec9f8206a17b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:16.431079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-64bff651-5fc8-4352-a96e-ec9f8206a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:16.490324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c44f6-f84a-4f2a-9f05-a73b8f1e6cc6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:16.490758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c44f6-f84a-4f2a-9f05-a73b8f1e6cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:16.491227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c44f6-f84a-4f2a-9f05-a73b8f1e6cc6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:16.493223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 146/296] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:16.499196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1627-be4d-4684-9794-b81a719ea27e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:16.499520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1627-be4d-4684-9794-b81a719ea27e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:16.499737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1627-be4d-4684-9794-b81a719ea27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:16.514786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 151/297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:16.521897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-30cd1627-be4d-4684-9794-b81a719ea27e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:16.521897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-30cd1627-be4d-4684-9794-b81a719ea27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:16.602000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:16.625826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792533c-76b0-4997-8837-de33937d40b2 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:16.625826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792533c-76b0-4997-8837-de33937d40b2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:16.625826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792533c-76b0-4997-8837-de33937d40b2 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:16.625826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 152/299] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:16.629163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a0ab-2ce6-4fc9-92ad-277c9873975e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:16.629448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a0ab-2ce6-4fc9-92ad-277c9873975e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:16.629715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a0ab-2ce6-4fc9-92ad-277c9873975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:16.648804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2074a0ab-2ce6-4fc9-92ad-277c9873975e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:16.650593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2074a0ab-2ce6-4fc9-92ad-277c9873975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:16.672899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:16.719244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 148/300] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:16.815655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792533c-76b0-4997-8837-de33937d40b2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:16.877117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074a0ab-2ce6-4fc9-92ad-277c9873975e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:16.936339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792533c-76b0-4997-8837-de33937d40b2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:16.964972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:16.974975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:16.975620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:16.975898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:16.976160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:16.986959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:16.992345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:16.993467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 153/301] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:16.994381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.011128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074a0ab-2ce6-4fc9-92ad-277c9873975e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.050384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.051325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.051776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.052212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.062584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:17.067675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:17.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:17.069344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:17.071195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 149/302] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:17.072113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.091435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:17.108637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f55bc-6b7a-4381-b14a-62b5c93b87d7 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.147124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.147974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.148986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.149258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.150382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.151811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.153956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 154/303] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:17.158694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.181714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486a112-ff8c-472d-93da-254ba460b5fd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.216228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.216750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.217022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.217287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.217966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:17.218270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.218682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:17.219717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.232660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 150/304] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:17.232660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.268888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a45f-e013-448d-8102-3741be94fe52 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.308385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.309000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.309272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.309537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.310942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:17.310942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.311894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.319697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:17.321185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 155/305] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:17.322063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.347211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfc3d-1ab5-4dbd-bad9-ed36f47b68bc None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.381043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.381710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.382010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.382275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] PATH_INFO: `/v3/groups` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.382893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.384334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.409825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 151/306] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 30 09:22:17 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:17.409825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.438749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf624ec-3967-4599-bf75-218e9673739c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.458425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:17.483532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.485073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.485466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.485736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] PATH_INFO: `/v3/users/6a6295aca67f41a695783e51d007aefd` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.487365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] RBAC: Authorizing `identity:get_user(user_id=6a6295aca67f41a695783e51d007aefd)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.490347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.492292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 156/307] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:17 2022] GET /identity/v3/users/6a6295aca67f41a695783e51d007aefd => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:17.498705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.535117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b3ecf-bcf7-401d-86ef-5421b7639e36 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.575485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.576282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.576671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.577033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] PATH_INFO: `/v3/users/c7cd1f57b6f54eb2ae721d4038907642` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.587591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:17.595004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1f57b6f54eb2ae721d4038907642)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.597272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.605437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 152/308] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:17 2022] GET /identity/v3/users/c7cd1f57b6f54eb2ae721d4038907642 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:17.606611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:17.640315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ccc14-4960-4f72-adab-2a2c7cf5196e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.679509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047c5d5-7cfb-4f66-8a62-6df5e77773f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.680178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047c5d5-7cfb-4f66-8a62-6df5e77773f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.680433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047c5d5-7cfb-4f66-8a62-6df5e77773f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.680699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047c5d5-7cfb-4f66-8a62-6df5e77773f4 None admin] PATH_INFO: `/v3/system/users/6a6295aca67f41a695783e51d007aefd/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.682147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047c5d5-7cfb-4f66-8a62-6df5e77773f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6a6295aca67f41a695783e51d007aefd, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.683515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047c5d5-7cfb-4f66-8a62-6df5e77773f4 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.693830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 157/309] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 30 09:22:17 2022] PUT /identity/v3/system/users/6a6295aca67f41a695783e51d007aefd/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:17.741058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a7c0-c108-4ebf-bfa7-c365af2da07f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:17.784373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772444-9cce-416b-af4e-c63a318811f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:17.785420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772444-9cce-416b-af4e-c63a318811f2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.785944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772444-9cce-416b-af4e-c63a318811f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.786441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772444-9cce-416b-af4e-c63a318811f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.787436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772444-9cce-416b-af4e-c63a318811f2 None admin] RBAC: Adding query filter params (role.id=4c0caecb94cb472ab6c1d958b8af8df9, user.id=c7cd1f57b6f54eb2ae721d4038907642, scope.system=all) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:17.787958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772444-9cce-416b-af4e-c63a318811f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:17.790118 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772444-9cce-416b-af4e-c63a318811f2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:17.796988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 153/310] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 30 09:22:17 2022] GET /identity/v3/role_assignments?user.id=c7cd1f57b6f54eb2ae721d4038907642&scope.system=all&role.id=4c0caecb94cb472ab6c1d958b8af8df9 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:17.905612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067843-d149-4584-a459-32266b6214b3 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.905965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067843-d149-4584-a459-32266b6214b3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.906186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067843-d149-4584-a459-32266b6214b3 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.908310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 158/311] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:17.914632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80948-d640-4b38-8ab3-e62635ddc0b8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:17.914945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80948-d640-4b38-8ab3-e62635ddc0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:17.915171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80948-d640-4b38-8ab3-e62635ddc0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:17.935032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cda80948-d640-4b38-8ab3-e62635ddc0b8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:17.936279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cda80948-d640-4b38-8ab3-e62635ddc0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:18.000392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:18.015917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 154/312] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:18.289232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067843-d149-4584-a459-32266b6214b3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:18.342824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:18.397095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067843-d149-4584-a459-32266b6214b3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:18.432918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:18.433586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:18.433895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:18.434166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:18.446292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:18.451743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:18.452621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:18.453410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:18.459228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80948-d640-4b38-8ab3-e62635ddc0b8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:18.561788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80948-d640-4b38-8ab3-e62635ddc0b8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:18.596142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:18.596749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:18.597022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:18.597283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:18.598021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:18.598318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:18.599697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:18.613099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 155/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:18.618692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:18.724755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57f949-736d-4cb2-b88c-e4d918685d8c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:18.735313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:18.760993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:18.762169 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:18.762642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:18.763105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] PATH_INFO: `/v3/users/ae4259584b454a8282cd4416e3b704ac` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:18.764431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] RBAC: Authorizing `identity:get_user(user_id=ae4259584b454a8282cd4416e3b704ac)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:18.766214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:18.768350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 160/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:18 2022] GET /identity/v3/users/ae4259584b454a8282cd4416e3b704ac => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:18.774292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:18.827939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:18.880368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad75777-9199-41b8-a295-893632c5dbad None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:18.914183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:18.915100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:18.915571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:18.916033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:18.983497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:18.985637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:19.046624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:19.101019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:19.106905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:19.209097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eae72-f511-46ee-8999-dc9db64ae19a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:19.244399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36283fa-bbed-4094-a273-fae82ee2a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:19.245040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36283fa-bbed-4094-a273-fae82ee2a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:19.245312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36283fa-bbed-4094-a273-fae82ee2a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:19.245579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36283fa-bbed-4094-a273-fae82ee2a0c1 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:19.246786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36283fa-bbed-4094-a273-fae82ee2a0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:19.248235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36283fa-bbed-4094-a273-fae82ee2a0c1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:19.250188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:19 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:19.256174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:19.358165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2142311-1158-4b27-a09b-044e72658fab None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:19.393298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231491e-9c54-404e-9e3e-e01787935a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:19.393926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231491e-9c54-404e-9e3e-e01787935a8e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:19.394200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231491e-9c54-404e-9e3e-e01787935a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:19.394463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231491e-9c54-404e-9e3e-e01787935a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:19.395253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231491e-9c54-404e-9e3e-e01787935a8e None admin] RBAC: Adding query filter params (role.id=4c0caecb94cb472ab6c1d958b8af8df9, scope.project.id=2ee5bc1312f843f487f7007653e1718f, user.id=ae4259584b454a8282cd4416e3b704ac) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:19.395557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231491e-9c54-404e-9e3e-e01787935a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:19.396999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231491e-9c54-404e-9e3e-e01787935a8e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:19.403563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:19 2022] GET /identity/v3/role_assignments?user.id=ae4259584b454a8282cd4416e3b704ac&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=4c0caecb94cb472ab6c1d958b8af8df9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:19.726358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c5c8-3a15-4e69-86dc-cdbfec7eefaa None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:19.726897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c5c8-3a15-4e69-86dc-cdbfec7eefaa None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:19.726897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c5c8-3a15-4e69-86dc-cdbfec7eefaa None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:19.728201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 162/319] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:19.733918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1cde7-c146-4838-9e03-45209d28c60a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:19.734337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1cde7-c146-4838-9e03-45209d28c60a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:19.734411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1cde7-c146-4838-9e03-45209d28c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:19.753741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-89d1cde7-c146-4838-9e03-45209d28c60a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:19.754965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-89d1cde7-c146-4838-9e03-45209d28c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:19.766341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:19.823533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 158/320] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:20.010793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67ca1-3e4b-488c-876e-4ed624dd8c06 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.010983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67ca1-3e4b-488c-876e-4ed624dd8c06 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.011253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67ca1-3e4b-488c-876e-4ed624dd8c06 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.012830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 163/321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:20.018825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd4a08-3f5e-436b-9bb7-ed9c875bfeac None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.019159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd4a08-3f5e-436b-9bb7-ed9c875bfeac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.019315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd4a08-3f5e-436b-9bb7-ed9c875bfeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.039678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e7dd4a08-3f5e-436b-9bb7-ed9c875bfeac None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:20.040868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e7dd4a08-3f5e-436b-9bb7-ed9c875bfeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:20.085696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67ca1-3e4b-488c-876e-4ed624dd8c06 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.110337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 159/322] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:20.131264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbbe63-8c47-404e-a999-9f26400df1af None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.131567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbbe63-8c47-404e-a999-9f26400df1af None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.131818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbbe63-8c47-404e-a999-9f26400df1af None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.133257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 160/323] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:20.138132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2dfe-21e2-4cb4-9bd1-e23f8ede4221 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.138409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2dfe-21e2-4cb4-9bd1-e23f8ede4221 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.138676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2dfe-21e2-4cb4-9bd1-e23f8ede4221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.144891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:20.157632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-efcf2dfe-21e2-4cb4-9bd1-e23f8ede4221 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:20.158847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-efcf2dfe-21e2-4cb4-9bd1-e23f8ede4221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:20.202901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67ca1-3e4b-488c-876e-4ed624dd8c06 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:20.231097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 161/324] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:20.241322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:20.242004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.242480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.242752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.244012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:20.245459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:20.251719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 164/325] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:20.253257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2dfe-21e2-4cb4-9bd1-e23f8ede4221 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.262353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:20.357610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2dfe-21e2-4cb4-9bd1-e23f8ede4221 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:20.374005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.392411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:20.393017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.393292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.393556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] PATH_INFO: `/v3/groups` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.394332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:20.395990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:20.414335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 162/326] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 30 09:22:20 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:22:20.485136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e9990-6cd3-4f5e-bd3c-8c070e8008fa None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:20.493697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.500771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:20.524508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:20.525068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.525344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.525613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.537933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:20.543827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:20.544960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:20.547438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 165/327] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:20.551225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.571649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:20.615320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca77873-75d4-421f-8906-340d5004f890 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:20.654336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:20.655225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.655747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.656168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.669755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:20.676538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:20.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:20.678711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 163/328] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:20.679370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf52193-9fe3-4c45-9595-677b34dcdb18 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:20.682278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.732617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:20.733275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.733521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.733786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.734599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:20.735109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:20.736507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:20.748444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 166/329] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:20.754724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.797008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:20.798916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f990-7735-45b1-9b62-b1c69ebeecaa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:20.837289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:20.847995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:20.848617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.848892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.849158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.849849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:20.850153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:20.851577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:20.864364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 164/330] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:20.869651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:20.892635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7810e9-5a31-4df0-a14c-0e10264d8231 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:20.938442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:20.939101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:20.939380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:20.939647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] PATH_INFO: `/v3/users/c7cd1f57b6f54eb2ae721d4038907642` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:20.942221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1f57b6f54eb2ae721d4038907642)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:20.945337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:20.948367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 167/331] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:20 2022] GET /identity/v3/users/c7cd1f57b6f54eb2ae721d4038907642 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:20.954562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:21.020299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a908af-33f4-4b60-9c75-1ae74663a21b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:21.067450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:21.068181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:21.068545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:21.068900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] PATH_INFO: `/v3/users/6a6295aca67f41a695783e51d007aefd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:21.070339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] RBAC: Authorizing `identity:get_user(user_id=6a6295aca67f41a695783e51d007aefd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:21.072663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:21.074800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 165/332] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:20 2022] GET /identity/v3/users/6a6295aca67f41a695783e51d007aefd => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:21.083832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:21.095421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b259e3-e6d0-40f5-91b4-ad7346c110b5 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:21.097357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:21.152498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a071b1f-f8fc-44b9-9b14-dfcbcf38a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:21.153168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071b1f-f8fc-44b9-9b14-dfcbcf38a956 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:21.153439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071b1f-f8fc-44b9-9b14-dfcbcf38a956 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:21.153707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071b1f-f8fc-44b9-9b14-dfcbcf38a956 None admin] PATH_INFO: `/v3/system/users/c7cd1f57b6f54eb2ae721d4038907642/roles/4c0caecb94cb472ab6c1d958b8af8df9` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:21.156649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a071b1f-f8fc-44b9-9b14-dfcbcf38a956 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c7cd1f57b6f54eb2ae721d4038907642, role_id=4c0caecb94cb472ab6c1d958b8af8df9)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:21.158023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a071b1f-f8fc-44b9-9b14-dfcbcf38a956 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:21.173827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 168/333] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 30 09:22:20 2022] PUT /identity/v3/system/users/c7cd1f57b6f54eb2ae721d4038907642/roles/4c0caecb94cb472ab6c1d958b8af8df9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:21.178134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:21.231149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf182cb-96e5-46c0-8231-ed7668ac068b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:21.270667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548e61-32b1-438c-9605-072ab09da4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:21.271343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548e61-32b1-438c-9605-072ab09da4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:21.271691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548e61-32b1-438c-9605-072ab09da4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:21.271893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548e61-32b1-438c-9605-072ab09da4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:21.272629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548e61-32b1-438c-9605-072ab09da4d5 None admin] RBAC: Adding query filter params (role.id=782248b1f9c44339b15e3eb0eabcd15a, user.id=6a6295aca67f41a695783e51d007aefd, scope.system=all) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:21.272932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548e61-32b1-438c-9605-072ab09da4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:21.274503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548e61-32b1-438c-9605-072ab09da4d5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:21.289089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 166/334] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 30 09:22:21 2022] GET /identity/v3/role_assignments?user.id=6a6295aca67f41a695783e51d007aefd&scope.system=all&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:23.188561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ff31-aceb-4546-b074-7f740b1d8025 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:23.189606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ff31-aceb-4546-b074-7f740b1d8025 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:23.190107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ff31-aceb-4546-b074-7f740b1d8025 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:23.191945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 169/335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:23.197651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c128681-ebc3-4361-ac23-7cf1f164893c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:23.198517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c128681-ebc3-4361-ac23-7cf1f164893c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:23.199006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c128681-ebc3-4361-ac23-7cf1f164893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:23.223844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8c128681-ebc3-4361-ac23-7cf1f164893c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:23.225586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8c128681-ebc3-4361-ac23-7cf1f164893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:23.316484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 167/336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:23.703917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555cb3-8802-4034-ae0c-4b9be7be04e6 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:23.704245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555cb3-8802-4034-ae0c-4b9be7be04e6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:23.704456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555cb3-8802-4034-ae0c-4b9be7be04e6 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:23.706130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 170/337] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:23.711557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a90e-f954-4afc-a404-5822e972c3bc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:23.711840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a90e-f954-4afc-a404-5822e972c3bc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:23.712109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a90e-f954-4afc-a404-5822e972c3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:23.736596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7501a90e-f954-4afc-a404-5822e972c3bc None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:23.737778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7501a90e-f954-4afc-a404-5822e972c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:23.794486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:23.829156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 168/338] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:23.863886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb653e6-d263-49f5-8a0d-45eb9e673dc4 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:23.864200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb653e6-d263-49f5-8a0d-45eb9e673dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:23.864442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb653e6-d263-49f5-8a0d-45eb9e673dc4 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:23.865985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 171/339] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:23.868925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501a90e-f954-4afc-a404-5822e972c3bc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:23.894797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef256-437f-40e5-8c96-e05ed6b7f644 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:23.895479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef256-437f-40e5-8c96-e05ed6b7f644 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:23.895946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef256-437f-40e5-8c96-e05ed6b7f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:23.930976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6b8ef256-437f-40e5-8c96-e05ed6b7f644 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:23.932565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6b8ef256-437f-40e5-8c96-e05ed6b7f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:24.029787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501a90e-f954-4afc-a404-5822e972c3bc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:24.086238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350868dd-9da4-404f-a76c-5ded43481650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:24.086878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350868dd-9da4-404f-a76c-5ded43481650 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:24.087150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350868dd-9da4-404f-a76c-5ded43481650 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:24.087417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350868dd-9da4-404f-a76c-5ded43481650 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:24.099755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350868dd-9da4-404f-a76c-5ded43481650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-350868dd-9da4-404f-a76c-5ded43481650 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:24.107153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:24.108040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:24.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 169/340] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:24.110074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007056c3-5dac-4775-b2f8-c3a1889e8686 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:24.110237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007056c3-5dac-4775-b2f8-c3a1889e8686 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:24.112071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007056c3-5dac-4775-b2f8-c3a1889e8686 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:24.112071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 170/341] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:24.113557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 172/342] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:24.118549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007056c3-5dac-4775-b2f8-c3a1889e8686 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:24.147788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48b5f-c2b5-497a-bf71-2a346ad793bc None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:24.147974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48b5f-c2b5-497a-bf71-2a346ad793bc None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:24.148248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48b5f-c2b5-497a-bf71-2a346ad793bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:24.189070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-fce48b5f-c2b5-497a-bf71-2a346ad793bc None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:24.190129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:24.190337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fce48b5f-c2b5-497a-bf71-2a346ad793bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:24.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007056c3-5dac-4775-b2f8-c3a1889e8686 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:24.321331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 173/343] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:24.322411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48b5f-c2b5-497a-bf71-2a346ad793bc None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:24.365519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:24.376394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:24.377005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:24.377323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:24.377588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:24.378337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:24.378633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:24.380017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:24.406416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 171/344] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:24.415311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:24.526524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48b5f-c2b5-497a-bf71-2a346ad793bc None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:24.558755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:24.571826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc785-0f38-419b-938b-cbea55ede928 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:24.601979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:24.602628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:24.602903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:24.603173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:24.628389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:24.632928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:24.633542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:24.633645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:24.634513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:24.635311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:24.635937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:24.635937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:24.636066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 174/345] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:24.644051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:24.744816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:24.746522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:24.798624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:24.818452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231284-4286-442c-a617-35445ad1ad71 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:24.867917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:24.868322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:24.868955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:24.869228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:24.869492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:24.872926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:24.872926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:24.872926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:24.874894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 172/346] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:24.875844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:24.886707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 175/347] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:24.887570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:24.993691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738eabd-b4fc-43d5-b64a-e9b1fb10ba2b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.018829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276ac8d-c2f5-44a2-806b-5ad4815da6bb None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.032969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.033653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.033964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.034260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.051518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:25.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:25.059506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:22:25.060330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:25.060928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 173/348] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:25.061478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.065937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.066626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.066903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.067172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.083294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:25.090463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:25.091455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:25.092243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:25.095123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 176/349] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:25.096239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.110354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:25.142826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:25.206618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb47d-ac7f-4ff4-ae13-679f2a95959d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.224717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926db6-bb85-4ed5-aa2c-4bbf651dd4c4 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.257172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.257840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.258124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.258398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.259525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:25.261009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:25.262725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 174/350] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:25.263491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.267211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cc9ba-c805-46ae-b658-6b38e9d2df06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.267826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc9ba-c805-46ae-b658-6b38e9d2df06 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.268097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc9ba-c805-46ae-b658-6b38e9d2df06 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.268470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc9ba-c805-46ae-b658-6b38e9d2df06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.366242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc9ba-c805-46ae-b658-6b38e9d2df06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:25.367732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc9ba-c805-46ae-b658-6b38e9d2df06 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:25.380907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:25.408731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b73c91-6a2c-407d-ac69-0343bbfb7e0c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.438791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:25.455712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.456333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.456608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.456876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.457542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:25.457871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:25.459276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:25.469267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 175/351] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:25.469834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.490953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 177/352] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:25.492564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c553c-3cec-46b2-a5ac-23f988388aa4 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.493031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c553c-3cec-46b2-a5ac-23f988388aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.493301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c553c-3cec-46b2-a5ac-23f988388aa4 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.494567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 178/353] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:25.495247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c553c-3cec-46b2-a5ac-23f988388aa4 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.595594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caff47-ad48-4b36-ab57-ab0c8fc430b3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.611592 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c553c-3cec-46b2-a5ac-23f988388aa4 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.624010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:25.638949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d9b58-062d-4d42-a9f0-3fe83c746b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.639562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9b58-062d-4d42-a9f0-3fe83c746b78 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.639832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9b58-062d-4d42-a9f0-3fe83c746b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.640093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9b58-062d-4d42-a9f0-3fe83c746b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.640741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9b58-062d-4d42-a9f0-3fe83c746b78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:25.641242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9b58-062d-4d42-a9f0-3fe83c746b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:25.642661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9b58-062d-4d42-a9f0-3fe83c746b78 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:25.653275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 176/354] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:25.654463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.654589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa863-8062-4e10-a374-e3470ff2c068 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.654665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.654756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa863-8062-4e10-a374-e3470ff2c068 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.654838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.655191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa863-8062-4e10-a374-e3470ff2c068 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.655285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.656779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 177/355] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:25.657595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa863-8062-4e10-a374-e3470ff2c068 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.666888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:25.668353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:25.670634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 179/356] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:25.670817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.725564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:25.784247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12659-ec6c-4cde-9fc8-e86c561301f8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.786269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa863-8062-4e10-a374-e3470ff2c068 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.822891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847f77-d63b-4bb3-82a9-1ab2e26bfef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.823530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847f77-d63b-4bb3-82a9-1ab2e26bfef8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.823817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847f77-d63b-4bb3-82a9-1ab2e26bfef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.824072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847f77-d63b-4bb3-82a9-1ab2e26bfef8 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.825183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847f77-d63b-4bb3-82a9-1ab2e26bfef8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:25.826653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847f77-d63b-4bb3-82a9-1ab2e26bfef8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:25.828463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 180/357] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:25.833084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b261c2-13b8-4c6f-8fb4-0e381afe714e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.833084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b261c2-13b8-4c6f-8fb4-0e381afe714e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.833084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b261c2-13b8-4c6f-8fb4-0e381afe714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.834243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:25.834394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.834662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.834924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] PATH_INFO: `/v3/users/c7cd1f57b6f54eb2ae721d4038907642` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.836635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd1f57b6f54eb2ae721d4038907642)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:25.837650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:25.839594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 178/358] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/users/c7cd1f57b6f54eb2ae721d4038907642 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:25.840369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:25.853140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-87b261c2-13b8-4c6f-8fb4-0e381afe714e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:25.854635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-87b261c2-13b8-4c6f-8fb4-0e381afe714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:25.893688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:25.936302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 181/359] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:25.937358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b0500-928c-4146-bd24-3ffdfbec3df2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:25.937723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b0500-928c-4146-bd24-3ffdfbec3df2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:25.938043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b0500-928c-4146-bd24-3ffdfbec3df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:25.951385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021184ea-b786-4795-b493-cd56dd4f5812 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:25.959606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a69b0500-928c-4146-bd24-3ffdfbec3df2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:25.960988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a69b0500-928c-4146-bd24-3ffdfbec3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:25.971023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:26.001125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.001745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.002555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.002821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.044330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 182/360] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:26.044986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b0500-928c-4146-bd24-3ffdfbec3df2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.085647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:26.087170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:26.174085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:26.177614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b0500-928c-4146-bd24-3ffdfbec3df2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.206464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 179/361] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:26.207241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.217590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.218670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.219324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.219929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.220907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=b5d6f4402df346168c2f6561120c3c31) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:26.221404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:26.223294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:26.225738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:26.230920 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 183/362] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:26.232427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.317621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea48aa-7948-45d1-9c25-87c6183cb5a6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.350632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80160-b074-4b96-8658-9529a44525c1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.359193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.359906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.360176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.360623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.362294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:26.364235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:26.365544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 180/363] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:26.366351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.394049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.395049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.395323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.395593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.396329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] RBAC: Adding query filter params (role.id=4c0caecb94cb472ab6c1d958b8af8df9, user.id=c7cd1f57b6f54eb2ae721d4038907642, scope.system=all) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:26.396644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:26.398116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:26.413060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 184/364] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/role_assignments?user.id=c7cd1f57b6f54eb2ae721d4038907642&scope.system=all&role.id=4c0caecb94cb472ab6c1d958b8af8df9 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:26.422420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.464923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:26.487800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:26.511534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb6012-f7cf-4134-83d0-6acb1562d8d6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.551336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.552051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.552321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.552588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.556113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:26.557707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:26.559801 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 181/365] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:26.560362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.562440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdf137-4621-45ee-b24b-1a3763a0ef05 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.608597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.609253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.609559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.609864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.621629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:26.628643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:26.629615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:26.630505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:26.632012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 185/366] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:26.632936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.695550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21b73a-d8d0-45e2-b706-34498c484251 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.735971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.736945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.737130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:26.737513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.737912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.738745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=b5d6f4402df346168c2f6561120c3c31) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:26.739141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:26.740809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:26.749692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 182/367] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:26.750758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.759907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475bad-4d1d-4991-8f69-9e421d8f154a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.780469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:26.819468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.821032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.821459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.821896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.837464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:26.844029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:26.845450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:26.846415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:26.850917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 186/368] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:26.850917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.899820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d25f7-f07a-495d-a6c8-672d4d2a8e91 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:26.939456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:26.940136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:26.940414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:26.940686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:26.941885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:26.943882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:26.945076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 183/369] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:26.946007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:26.972466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0196-9c1f-410b-b692-48e3cbb800c2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:27.008643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:27.009608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:27.009911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:27.010181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:27.010993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:27.011291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:27.012710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:27.023368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 187/370] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:27.024278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:27.028989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:27.070821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:27.092333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f1cc-7da0-4536-9df9-0553c63e3556 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:27.139347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:27.139964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:27.140237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:27.140563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:27.141564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:27.142340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:27.143479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:27.153629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 184/371] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:27.153953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:27.159591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e13f8-a84c-4e52-b079-45b1e2cf5865 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:27.202923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:27.204500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:27.204982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:27.205910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:27.207146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=2ee5bc1312f843f487f7007653e1718f) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:27.207662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:27.210232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:27.218350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 188/372] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:27 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:27.219540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:27.290236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03995e3-22a1-4957-8142-433af4e39623 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:27.308381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:27.341642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:27.343302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:27.343580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:27.343844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:27.381507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:27.385316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430fe02-3ec4-43d3-a689-cf72f98ab702 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:27.457354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:27.461185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:27.461464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:27.461825 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:27.496670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:27.498899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:27.547988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:27.549524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:27.639632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 185/373] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:27.646524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:27.690122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:27.733384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:27.754346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 189/374] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:27.760273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:27.845913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e8847-1770-4ead-a56f-fc97c0f2d901 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:27.906512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:27.907151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:27.907454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:27.907671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:27.908803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:27.910333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:27.912271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 186/375] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:27 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:27.918713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:27.940231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f365c4f-fda9-43c4-81f0-eb73f1edf3a0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:28.007481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:28.008139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:28.008417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:28.008690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] PATH_INFO: `/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:28.014653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] RBAC: Authorizing `identity:get_project(project_id=ebff7cf09dfd4e619d4653fe8d95360a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:28.016280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:28.018572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 190/376] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:27 2022] GET /identity/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:28.024141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:28.036157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a820d-76bf-4186-a30d-113541983cc8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:28.051061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:28.071766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:28.072403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:28.072672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:28.072927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:28.074074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:28.075531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:28.077406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 187/377] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:27 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:28.084872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:28.099476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:28.193936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195285e-298f-4e31-91de-ee83d8860877 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:28.223047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47352b6-c85c-47eb-9a77-c9ce66f2800a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:28.231683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:28.232290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:28.232556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:28.233887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:28.233887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=2ee5bc1312f843f487f7007653e1718f) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:28.233887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:28.239221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:28.250163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 188/378] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:28 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:28.275451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f77ac0-10aa-4b40-9c73-3dfedc779cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:28.276153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77ac0-10aa-4b40-9c73-3dfedc779cff None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:28.276463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77ac0-10aa-4b40-9c73-3dfedc779cff None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:28.276725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77ac0-10aa-4b40-9c73-3dfedc779cff None admin] PATH_INFO: `/v3/groups/1891171e1ff443cda645253780f73243` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:28.282887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f77ac0-10aa-4b40-9c73-3dfedc779cff None admin] RBAC: Authorizing `identity:get_group(group_id=1891171e1ff443cda645253780f73243)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:28.284366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f77ac0-10aa-4b40-9c73-3dfedc779cff None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:28.286459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 191/379] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:28 2022] GET /identity/v3/groups/1891171e1ff443cda645253780f73243 => generated 229 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:28.292870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:28.354304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:28.401618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f4131-9f05-4193-943a-99fcdfa9aebb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:28.440616 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf807a3-d8a9-4fea-858f-6c61bc966761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:28.441294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf807a3-d8a9-4fea-858f-6c61bc966761 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:28.441567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf807a3-d8a9-4fea-858f-6c61bc966761 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:28.441861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf807a3-d8a9-4fea-858f-6c61bc966761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:28.442768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf807a3-d8a9-4fea-858f-6c61bc966761 None admin] RBAC: Adding query filter params (group.id=1891171e1ff443cda645253780f73243, role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=ebff7cf09dfd4e619d4653fe8d95360a) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:28.443071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf807a3-d8a9-4fea-858f-6c61bc966761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:28.444545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf807a3-d8a9-4fea-858f-6c61bc966761 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:28.451239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 189/380] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:28 2022] GET /identity/v3/role_assignments?group.id=1891171e1ff443cda645253780f73243&scope.project.id=ebff7cf09dfd4e619d4653fe8d95360a&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:29.186302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da7c6-a7b9-42a8-81c5-7e0fc0aafda5 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:29.187313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da7c6-a7b9-42a8-81c5-7e0fc0aafda5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:29.187870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da7c6-a7b9-42a8-81c5-7e0fc0aafda5 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:29.189679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 192/381] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:29.195607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dea915-03cf-44ba-94eb-40898ada1a45 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:29.196494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dea915-03cf-44ba-94eb-40898ada1a45 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:29.196972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dea915-03cf-44ba-94eb-40898ada1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:29.215769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d6dea915-03cf-44ba-94eb-40898ada1a45 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:29.217281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d6dea915-03cf-44ba-94eb-40898ada1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:29.309243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 190/382] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:29.469923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff039-d578-4185-9aec-bb0143456b3b None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:29.469923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff039-d578-4185-9aec-bb0143456b3b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:29.469923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff039-d578-4185-9aec-bb0143456b3b None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:29.470526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 193/383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:29.475992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b81c-e6d3-417e-b024-7427dad731e9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:29.476530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b81c-e6d3-417e-b024-7427dad731e9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:29.476988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b81c-e6d3-417e-b024-7427dad731e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:29.497115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-97d5b81c-e6d3-417e-b024-7427dad731e9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:29.498719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-97d5b81c-e6d3-417e-b024-7427dad731e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:29.534288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:29.569000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 191/384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:29.747779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ff039-d578-4185-9aec-bb0143456b3b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:29.857667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:29.862875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ff039-d578-4185-9aec-bb0143456b3b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:29.904051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:29.905037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:29.905497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:29.905993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:29.919962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b81c-e6d3-417e-b024-7427dad731e9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:29.920816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:29.926203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:29.927086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:29.927868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:29.931467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 194/385] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:29.937819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.042548 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02c769-c719-4860-811d-69cfec1380f8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.052576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b81c-e6d3-417e-b024-7427dad731e9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.083524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba8bdf-b404-47e2-9b6b-5594fc7f9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.084140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba8bdf-b404-47e2-9b6b-5594fc7f9374 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.084417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba8bdf-b404-47e2-9b6b-5594fc7f9374 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.084687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba8bdf-b404-47e2-9b6b-5594fc7f9374 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.085353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba8bdf-b404-47e2-9b6b-5594fc7f9374 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:30.085652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba8bdf-b404-47e2-9b6b-5594fc7f9374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:30.087070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba8bdf-b404-47e2-9b6b-5594fc7f9374 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:30.087802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6426211-9df3-412f-b489-a72ce0d95ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.088538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6426211-9df3-412f-b489-a72ce0d95ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.088813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6426211-9df3-412f-b489-a72ce0d95ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.089078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6426211-9df3-412f-b489-a72ce0d95ca7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.096332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 195/386] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:30.097595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264f61a-ae9a-4945-9bb4-8ab98945ccbb None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.097899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264f61a-ae9a-4945-9bb4-8ab98945ccbb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.098172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264f61a-ae9a-4945-9bb4-8ab98945ccbb None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.099608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 196/387] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:30.105055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6426211-9df3-412f-b489-a72ce0d95ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:30.106673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264f61a-ae9a-4945-9bb4-8ab98945ccbb None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d6426211-9df3-412f-b489-a72ce0d95ca7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:30.110371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:30.111258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:30.112059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 192/388] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:30.113268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd725ca-fd8c-4192-8b2f-1419df6955ea None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.113268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd725ca-fd8c-4192-8b2f-1419df6955ea None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.113546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd725ca-fd8c-4192-8b2f-1419df6955ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.135733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9dd725ca-fd8c-4192-8b2f-1419df6955ea None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:30.136906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9dd725ca-fd8c-4192-8b2f-1419df6955ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:30.142192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:30.162391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:30.221831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 193/389] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:30.221831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd725ca-fd8c-4192-8b2f-1419df6955ea None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.244473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264f61a-ae9a-4945-9bb4-8ab98945ccbb None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.282233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.282873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.283142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.283405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.284518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:30.285956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:30.287816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 197/390] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:30 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:30.299075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.375338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd725ca-fd8c-4192-8b2f-1419df6955ea None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.412770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.414308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.414772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.415644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.416290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:30.416909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:30.418554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:30.429812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 194/391] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:30.436282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.487426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:30.501716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:30.523722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cbdbb-fb81-465d-87df-71fca9f4f771 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.575030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.576197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.577091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.577824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.583030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:30.585039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:30.586344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582113-cc77-4bf1-97bd-54ea4394cb49 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.587480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 198/392] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:30 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:30.588789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.633622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.634310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.634611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.634833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.635946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:30.637619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:30.639613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 195/393] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:30 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:30.640446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.711869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942ddf8-5199-4c3e-9f2e-127789d53579 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.738073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:30.750284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e2f4b-60e0-4099-a4e6-7467fcc76794 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:30.750618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.751515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.752146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.753386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.765575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:30.771778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:30.772672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:30.773471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:30.776445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 199/394] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:30.777422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.794794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:30.796019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:30.796941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:30.797690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31/groups/a902c3651d564272ae0bfe203d2c992c/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:30.799947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:30.800955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d6f4402df346168c2f6561120c3c31, group_id=a902c3651d564272ae0bfe203d2c992c, role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:30.802744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:30.823383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 196/395] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 30 09:22:30 2022] PUT /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31/groups/a902c3651d564272ae0bfe203d2c992c/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:30.824791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:30.966190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478578-40c1-4ce9-bed5-4d0360b0db70 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.008511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae5e5a-be6e-4026-b621-af8bf3c533bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.009509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5e5a-be6e-4026-b621-af8bf3c533bb None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.010020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5e5a-be6e-4026-b621-af8bf3c533bb None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.010634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5e5a-be6e-4026-b621-af8bf3c533bb None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.012680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae5e5a-be6e-4026-b621-af8bf3c533bb None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:31.014461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae5e5a-be6e-4026-b621-af8bf3c533bb None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:31.021232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 200/396] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:30 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:31.021232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16014a-35b5-45c7-888d-ed100671f26e None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.021232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16014a-35b5-45c7-888d-ed100671f26e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.021232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16014a-35b5-45c7-888d-ed100671f26e None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.021232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 201/397] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:31.022232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16014a-35b5-45c7-888d-ed100671f26e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.030894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a2c1-5139-4f79-b142-0730b5a1a632 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.076704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a05f2-2edd-45f3-89e7-a4f6a80fc118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.077673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a05f2-2edd-45f3-89e7-a4f6a80fc118 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.078186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a05f2-2edd-45f3-89e7-a4f6a80fc118 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.078627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a05f2-2edd-45f3-89e7-a4f6a80fc118 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.079661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a05f2-2edd-45f3-89e7-a4f6a80fc118 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:31.080136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a05f2-2edd-45f3-89e7-a4f6a80fc118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:31.082108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a05f2-2edd-45f3-89e7-a4f6a80fc118 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:31.091266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 197/398] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:31.092712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50e09-6cdb-491e-849e-0d5301d165ce None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.092987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50e09-6cdb-491e-849e-0d5301d165ce None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.093266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50e09-6cdb-491e-849e-0d5301d165ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.111181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-64a50e09-6cdb-491e-849e-0d5301d165ce None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:31.112372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-64a50e09-6cdb-491e-849e-0d5301d165ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:31.120065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:31.131139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:31.148369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16014a-35b5-45c7-888d-ed100671f26e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.183210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 198/399] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:31.184838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9f4a4-435a-48ed-924a-759d61d10202 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.185114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9f4a4-435a-48ed-924a-759d61d10202 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.185376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9f4a4-435a-48ed-924a-759d61d10202 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.186787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 199/400] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:31.191661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9f4a4-435a-48ed-924a-759d61d10202 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.213452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd95c9-a249-49bd-b316-a95ac6397cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.214188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd95c9-a249-49bd-b316-a95ac6397cc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.214465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd95c9-a249-49bd-b316-a95ac6397cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.214831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd95c9-a249-49bd-b316-a95ac6397cc7 None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31/groups/a902c3651d564272ae0bfe203d2c992c/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.218344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd95c9-a249-49bd-b316-a95ac6397cc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d6f4402df346168c2f6561120c3c31, group_id=a902c3651d564272ae0bfe203d2c992c, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:31.220243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd95c9-a249-49bd-b316-a95ac6397cc7 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:31.238818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 202/401] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 30 09:22:31 2022] PUT /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31/groups/a902c3651d564272ae0bfe203d2c992c/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:22:31.240357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac61b4-bf09-49ff-962b-2731aaf2f3a2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.240713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac61b4-bf09-49ff-962b-2731aaf2f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.241027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac61b4-bf09-49ff-962b-2731aaf2f3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.263363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f9ac61b4-bf09-49ff-962b-2731aaf2f3a2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:31.264721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f9ac61b4-bf09-49ff-962b-2731aaf2f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:31.339308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 203/402] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:31.407164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9f4a4-435a-48ed-924a-759d61d10202 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.473514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.474114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.474392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.474659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.475862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:31.477313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:31.478936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 200/403] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:31 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:31.485097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac61b4-bf09-49ff-962b-2731aaf2f3a2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.501996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.540571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:31.574877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:31.602395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac61b4-bf09-49ff-962b-2731aaf2f3a2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.648621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.649043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.649316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.649580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.650754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:31.652196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:31.653869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 204/404] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:31 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:31.659238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.693440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3086a-59f9-48d0-a7af-e00f872d6347 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.739152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.739855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.740193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.740518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.757060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:31.762651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:31.763600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:31.764403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:31.767190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 201/405] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:31.768201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.771988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561655b-6b26-4181-8ef2-a672c38f0bf9 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.816855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.817778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.818151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.818511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.832030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:31.837743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:31.838943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:31.839926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:31.841593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 205/406] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:31.842575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.847858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:31.850361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:31.881647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606d62-ee7b-40c9-a048-85f9b0b14873 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:31.917927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:31.918835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:31.919253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:31.919664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f/groups/a902c3651d564272ae0bfe203d2c992c/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:31.922695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5bc1312f843f487f7007653e1718f, group_id=a902c3651d564272ae0bfe203d2c992c, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:31.924822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:31.950248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 202/407] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 30 09:22:31 2022] PUT /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f/groups/a902c3651d564272ae0bfe203d2c992c/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:31.950248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:31.999960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538562-38ea-40f9-b3a5-ad999df5cc92 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.065899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d283-4ebc-4da2-b3b0-726aaeb92e32 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.105274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.106116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.106484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.106846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.107640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:32.108039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.109659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.119565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 203/408] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:32.122295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:32.127221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:32.134605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.135222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.135495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.135772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.136456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:32.136756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.138204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.163384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 206/409] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:32.169728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:32.246978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:32.253127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054def-b8aa-4e54-ae16-01aeeda2fa01 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.289776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2168a8a-b1b9-4e28-99e5-ef1bd4031eef None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.296445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.297423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.297694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.297989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] PATH_INFO: `/v3/groups/1891171e1ff443cda645253780f73243` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.299147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] RBAC: Authorizing `identity:get_group(group_id=1891171e1ff443cda645253780f73243)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.301141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.303931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 204/410] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:32 2022] GET /identity/v3/groups/1891171e1ff443cda645253780f73243 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:32.309378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:32.333140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.333704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.334005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.334284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.335411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.336864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.338807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 207/411] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:32 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:32.344293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:32.396101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:32.481763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6c7c7-85f1-4ed1-8767-88b9b462c33c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.527010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f1d03-6079-4720-85e8-7b396144862c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.531005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.531878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.532352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.533618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] PATH_INFO: `/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.537588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] RBAC: Authorizing `identity:get_project(project_id=ebff7cf09dfd4e619d4653fe8d95360a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.539677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.543980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:32 2022] GET /identity/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:32.549781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:32.603257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.604459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.605611 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.606216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.607633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.609364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.612456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 208/413] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:32 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:32.619615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:32.621874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:32.711378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c13e46-e299-45f9-8bdc-780e2db39c90 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.742000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:32.753405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234321b-acae-4175-b2ff-d8dc55bf2e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.754454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234321b-acae-4175-b2ff-d8dc55bf2e46 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.754919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234321b-acae-4175-b2ff-d8dc55bf2e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.755370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234321b-acae-4175-b2ff-d8dc55bf2e46 None admin] PATH_INFO: `/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a/groups/1891171e1ff443cda645253780f73243/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.757503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234321b-acae-4175-b2ff-d8dc55bf2e46 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebff7cf09dfd4e619d4653fe8d95360a, group_id=1891171e1ff443cda645253780f73243, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.759655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234321b-acae-4175-b2ff-d8dc55bf2e46 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.789510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 206/414] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 30 09:22:32 2022] PUT /identity/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a/groups/1891171e1ff443cda645253780f73243/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:22:32.820856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9daec-e77c-4297-a4af-2be54ed430a2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:32.860927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27688f26-495f-4ccc-ac6f-6c6996ee6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:32.862024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27688f26-495f-4ccc-ac6f-6c6996ee6f8d None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:32.862579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27688f26-495f-4ccc-ac6f-6c6996ee6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:32.863222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27688f26-495f-4ccc-ac6f-6c6996ee6f8d None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f/groups/a902c3651d564272ae0bfe203d2c992c/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:32.866603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27688f26-495f-4ccc-ac6f-6c6996ee6f8d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5bc1312f843f487f7007653e1718f, group_id=a902c3651d564272ae0bfe203d2c992c, role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:32.869007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27688f26-495f-4ccc-ac6f-6c6996ee6f8d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:32.886676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 209/415] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 30 09:22:32 2022] PUT /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f/groups/a902c3651d564272ae0bfe203d2c992c/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:22:33.309824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e128-85ab-4ee5-afcd-667f1c22db1c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:33.310224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e128-85ab-4ee5-afcd-667f1c22db1c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:33.310399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e128-85ab-4ee5-afcd-667f1c22db1c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:33.311844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 207/416] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:33.317603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800308-25bc-4869-bba3-9e5dfc90325e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:33.318491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800308-25bc-4869-bba3-9e5dfc90325e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:33.318969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800308-25bc-4869-bba3-9e5dfc90325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:33.338419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a0800308-25bc-4869-bba3-9e5dfc90325e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:33.339953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a0800308-25bc-4869-bba3-9e5dfc90325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:33.409587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:33.422518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 210/417] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:33.721226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c527e-69b9-4eb3-b405-df1bc50b78ec None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:33.721742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c527e-69b9-4eb3-b405-df1bc50b78ec None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:33.721871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c527e-69b9-4eb3-b405-df1bc50b78ec None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:33.723458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 208/418] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:33.728468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11953716-4342-4302-a215-53aea5ee8503 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:33.728752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11953716-4342-4302-a215-53aea5ee8503 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:33.729023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11953716-4342-4302-a215-53aea5ee8503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:33.752556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-11953716-4342-4302-a215-53aea5ee8503 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:33.753747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-11953716-4342-4302-a215-53aea5ee8503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:33.785269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c527e-69b9-4eb3-b405-df1bc50b78ec None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:33.829469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 211/419] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:33.959516 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c527e-69b9-4eb3-b405-df1bc50b78ec None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:34.003827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:34.004462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.004735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.005002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.018945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:34.024283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:34.025140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:34.025965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 209/420] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:34.031987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11953716-4342-4302-a215-53aea5ee8503 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:34.125631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:34.210345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:34.213112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11953716-4342-4302-a215-53aea5ee8503 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:34.241283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:34.256285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:34.257209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.257690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.258275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.259248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:34.259733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:34.261288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:34.271133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 212/421] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:34.283460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:34.311614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200917-afc0-4487-a2d9-12a906aba00b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:34.357861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:34.358505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.358786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.359061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.370768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:34.376865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:34.377759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:34.378582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 210/422] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:34.384180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:34.481682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615b50-679a-440d-b0d6-c0b1d51bd412 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:34.517819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:34.518500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.518789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.519053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.575649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:34.584016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a0a0-6420-4fec-9943-cb63869c485f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:34.594338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:34.595852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:34.602475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:34.674793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:34.675506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.675798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.676104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.676776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:34.677128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:34.679047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:34.697897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 211/423] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:34.709679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:34.712223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 213/424] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:34.721840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:34.807653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:34.811150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f9e8c-6df5-4211-a3d3-733e3a5a0226 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:34.824881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb89d4-d419-4a38-b9d9-b57b2b132347 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:34.844588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29ef85-eefa-4a8b-8890-d612089b51da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:34.845185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29ef85-eefa-4a8b-8890-d612089b51da None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.845458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29ef85-eefa-4a8b-8890-d612089b51da None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.845722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29ef85-eefa-4a8b-8890-d612089b51da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.861305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3ab73-4af3-4714-bfdc-4dbbadd6c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:34.862053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3ab73-4af3-4714-bfdc-4dbbadd6c0fb None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.862328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3ab73-4af3-4714-bfdc-4dbbadd6c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.862596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3ab73-4af3-4714-bfdc-4dbbadd6c0fb None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.863791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3ab73-4af3-4714-bfdc-4dbbadd6c0fb None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:34.865409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3ab73-4af3-4714-bfdc-4dbbadd6c0fb None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:34.871928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 214/425] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:34 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:34.873371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8c17-53a8-43d5-9cd0-02aa76914262 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:34.873651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8c17-53a8-43d5-9cd0-02aa76914262 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:34.873974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8c17-53a8-43d5-9cd0-02aa76914262 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:34.875366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 215/426] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:34.876070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8c17-53a8-43d5-9cd0-02aa76914262 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:34.889240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:34.918999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29ef85-eefa-4a8b-8890-d612089b51da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:34.920569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29ef85-eefa-4a8b-8890-d612089b51da None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:34.990665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8c17-53a8-43d5-9cd0-02aa76914262 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:35.027867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:35.028621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.028948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.029309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.030525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:35.032143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:35.036130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 212/428] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:35.037576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724df58d-8c89-4bbc-9b0e-34532bb9cc0f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.037883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724df58d-8c89-4bbc-9b0e-34532bb9cc0f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.038156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724df58d-8c89-4bbc-9b0e-34532bb9cc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.039224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 216/428] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:34 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:35.040063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:35.062191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-724df58d-8c89-4bbc-9b0e-34532bb9cc0f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:35.062992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:35.064826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-724df58d-8c89-4bbc-9b0e-34532bb9cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:35.144150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:35.150596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 213/429] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:35.151571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724df58d-8c89-4bbc-9b0e-34532bb9cc0f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:35.172683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e39c-a776-41ca-ae0a-d3b1751a7bed None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:35.243417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:35.244430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.244891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.245385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] PATH_INFO: `/v3/projects/b5d6f4402df346168c2f6561120c3c31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.249183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] RBAC: Authorizing `identity:get_project(project_id=b5d6f4402df346168c2f6561120c3c31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:35.251073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:35.253606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 217/430] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:35 2022] GET /identity/v3/projects/b5d6f4402df346168c2f6561120c3c31 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:35.263455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:35.278434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724df58d-8c89-4bbc-9b0e-34532bb9cc0f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:35.319449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:35.320088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.320374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.320644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.321371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=b5d6f4402df346168c2f6561120c3c31) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:35.321676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:35.323485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:35.330746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 214/431] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:35 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:35.395338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:35.412789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8215-0e09-4df7-b739-e9964d61be5f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:35.471773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:35.472693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.473111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.473516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.474936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:35.476573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:35.478448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 218/432] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:35 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:35.484682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:35.487531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:35.612927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:35.654142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475be461-7f5a-47cb-9b58-b4d744416c72 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:35.662921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594b81e-b731-4072-a246-8d4186145ea8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:35.705050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0bf6-4beb-4deb-915e-0d404bacd2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:35.705696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0bf6-4beb-4deb-915e-0d404bacd2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.705990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0bf6-4beb-4deb-915e-0d404bacd2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.706254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0bf6-4beb-4deb-915e-0d404bacd2f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.707660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a3017-b643-4b32-9cbd-3f8d13ea2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:35.708258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3017-b643-4b32-9cbd-3f8d13ea2f91 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.708713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3017-b643-4b32-9cbd-3f8d13ea2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.708977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3017-b643-4b32-9cbd-3f8d13ea2f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.710052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a3017-b643-4b32-9cbd-3f8d13ea2f91 None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=b5d6f4402df346168c2f6561120c3c31) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:35.710358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a3017-b643-4b32-9cbd-3f8d13ea2f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:35.711807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a3017-b643-4b32-9cbd-3f8d13ea2f91 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:35.717427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0bf6-4beb-4deb-915e-0d404bacd2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:35.717915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 215/433] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:35 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=b5d6f4402df346168c2f6561120c3c31&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:35.719317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423cfa4-22ce-49b7-8f50-7fc708c846ad None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.719598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423cfa4-22ce-49b7-8f50-7fc708c846ad None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.719868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423cfa4-22ce-49b7-8f50-7fc708c846ad None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.723625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 216/434] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:35.723625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f41c53-84ab-40f0-8a42-942f60d237e9 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-f9ed0bf6-4beb-4deb-915e-0d404bacd2f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:35.723839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:35.724669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:22:35.725461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:35.726116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f41c53-84ab-40f0-8a42-942f60d237e9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.726116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f41c53-84ab-40f0-8a42-942f60d237e9 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.726255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 219/435] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:35.726324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 217/436] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:35.730665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ac7c-7cdb-46e9-9f0d-fee78da42541 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.731664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ac7c-7cdb-46e9-9f0d-fee78da42541 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.731664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ac7c-7cdb-46e9-9f0d-fee78da42541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.731853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f41c53-84ab-40f0-8a42-942f60d237e9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:35.752058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4490ac7c-7cdb-46e9-9f0d-fee78da42541 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:35.753291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4490ac7c-7cdb-46e9-9f0d-fee78da42541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:35.767475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:35.831098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 220/437] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:35.832373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4ed2-5283-48ad-acb7-22026afead1b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.832718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4ed2-5283-48ad-acb7-22026afead1b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.833052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4ed2-5283-48ad-acb7-22026afead1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.853071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-bc4a4ed2-5283-48ad-acb7-22026afead1b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:35.854539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-bc4a4ed2-5283-48ad-acb7-22026afead1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:35.862320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f41c53-84ab-40f0-8a42-942f60d237e9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:35.902286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:35.918238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:35.918854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:35.919128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:35.919400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:35.920062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:35.920357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:35.922214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:35.933057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 218/438] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:22:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:35.939681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:35.942236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 221/439] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:36.051862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd79486-5c04-4f0f-bd06-bdc4ea63374e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.087032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.087633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.087903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.088163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.095409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4ed2-5283-48ad-acb7-22026afead1b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.156446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.172460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.174024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:36.204199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.231626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4ed2-5283-48ad-acb7-22026afead1b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.275828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.276928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.276928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.277092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.286903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 219/440] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:36.288147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.290162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:36.295180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:36.296124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:36.297034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 222/441] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:36.297709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.391294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.401135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297320c-eb9a-4be4-8142-0391ae63424e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.403536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec251c5-6e0b-4d98-99cb-85063128ba59 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.434930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.435474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.435742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.436002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.436243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.436874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.437148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.437499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.438711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.440150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:36.441836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 223/442] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:36.442584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.445925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.450447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:36.455698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:36.456785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 220/443] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:36.457582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.551930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d58fd6-25a4-4361-9f43-93e78722420e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.555915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed569-341e-4ab8-a958-562cdf0dbb8e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.585855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.586458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.586787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.587028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.587848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:36.588137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.589757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:36.589992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.590637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.590884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.591302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.592445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.593963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:36.595528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 221/444] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:36.600693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.600814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 224/445] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:36.601452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.621106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.666328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.700233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033834f-cab6-4fc3-862c-062772f49e1b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.700963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232a62d-7032-4581-b332-6a3ecf18d8f2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.732759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.733387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.733497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.733657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.733960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.734057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.734379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.734649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.734799 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=782248b1f9c44339b15e3eb0eabcd15a, scope.project.id=2ee5bc1312f843f487f7007653e1718f) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:36.735096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.735299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:36.735601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.736515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:36.736951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:36.744081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 225/446] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=782248b1f9c44339b15e3eb0eabcd15a => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:36.744865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.745392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 222/447] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:36.751001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:36.852004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.869628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e372d-9092-4ec6-b55a-8a63635d9ff1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.874481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ad48f-1ab2-49c4-a09a-65dab3556c31 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:36.903704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:36.911487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.912117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.912387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.912655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.913870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:36.914479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:36.914751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:36.915014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:36.990749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.992173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:36.997031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:36.998517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:37.084554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:37.107867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 223/448] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:22:37.113651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 226/449] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:37.114249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:37.119256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:37.152537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:37.217100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fa26d-1639-4d6b-8073-cc58298c9e68 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:37.225047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a55a4-bb68-40e0-9cb2-6152a5e120f8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:37.251778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:37.252352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:37.252645 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:37.252900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] PATH_INFO: `/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:37.254031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] RBAC: Authorizing `identity:get_project(project_id=ebff7cf09dfd4e619d4653fe8d95360a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:37.255454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:37.257129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 224/450] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:37 2022] GET /identity/v3/projects/ebff7cf09dfd4e619d4653fe8d95360a => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:37.257708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:37.258363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:37.258633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:37.258897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] PATH_INFO: `/v3/projects/2ee5bc1312f843f487f7007653e1718f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:37.259999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee5bc1312f843f487f7007653e1718f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:37.261406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:37.262653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:37.267340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 227/451] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:22:37 2022] GET /identity/v3/projects/2ee5bc1312f843f487f7007653e1718f => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:37.268243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:37.310759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:37.360994 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbcae-67a0-4931-ab57-349364d33339 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:37.361171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:37.365012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fe992-8b01-4685-bc97-ecc51c1bcba0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:37.395069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:37.395684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:37.395954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:37.396219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] PATH_INFO: `/v3/groups/1891171e1ff443cda645253780f73243` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:37.397320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] RBAC: Authorizing `identity:get_group(group_id=1891171e1ff443cda645253780f73243)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:37.398651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:37.398808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:37.399283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:37.399557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:37.399825 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] PATH_INFO: `/v3/groups/a902c3651d564272ae0bfe203d2c992c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:37.400374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 225/452] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:37 2022] GET /identity/v3/groups/1891171e1ff443cda645253780f73243 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:37.400936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] RBAC: Authorizing `identity:get_group(group_id=a902c3651d564272ae0bfe203d2c992c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:37.402396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:37.403952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 228/453] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 30 09:22:37 2022] GET /identity/v3/groups/a902c3651d564272ae0bfe203d2c992c => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:37.406228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:37.409550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:37.510861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b98ac-f4e1-4a03-923f-d2cabb43263f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:37.511052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725a273-9700-4f34-aa36-ba562459c82c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:37.527121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:37.544773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a23122-c452-4631-a801-5923aa97b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:37.545128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a4c5d-f6b7-4b9a-838d-01cb5a495875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:37.545370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23122-c452-4631-a801-5923aa97b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:37.545638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23122-c452-4631-a801-5923aa97b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:37.545725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4c5d-f6b7-4b9a-838d-01cb5a495875 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:37.545935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23122-c452-4631-a801-5923aa97b3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:37.546026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4c5d-f6b7-4b9a-838d-01cb5a495875 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:37.546249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4c5d-f6b7-4b9a-838d-01cb5a495875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:37.546640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a23122-c452-4631-a801-5923aa97b3b3 None admin] RBAC: Adding query filter params (group.id=a902c3651d564272ae0bfe203d2c992c, role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=2ee5bc1312f843f487f7007653e1718f) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:37.546996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a23122-c452-4631-a801-5923aa97b3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:37.547101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4c5d-f6b7-4b9a-838d-01cb5a495875 None admin] RBAC: Adding query filter params (group.id=1891171e1ff443cda645253780f73243, role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=ebff7cf09dfd4e619d4653fe8d95360a) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:37.547345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4c5d-f6b7-4b9a-838d-01cb5a495875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:37.548427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a23122-c452-4631-a801-5923aa97b3b3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:37.548759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4c5d-f6b7-4b9a-838d-01cb5a495875 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:37.554543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 226/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:37 2022] GET /identity/v3/role_assignments?group.id=1891171e1ff443cda645253780f73243&scope.project.id=ebff7cf09dfd4e619d4653fe8d95360a&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:37.554674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 229/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 30 09:22:37 2022] GET /identity/v3/role_assignments?group.id=a902c3651d564272ae0bfe203d2c992c&scope.project.id=2ee5bc1312f843f487f7007653e1718f&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:40.633720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4db83-f3e3-4fb4-b674-7004bca50860 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:40.634697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4db83-f3e3-4fb4-b674-7004bca50860 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:40.635106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4db83-f3e3-4fb4-b674-7004bca50860 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:40.636869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 230/456] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:40.642016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606a21-0c8a-4ea5-8ce0-429ecf14ab7a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:40.642464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606a21-0c8a-4ea5-8ce0-429ecf14ab7a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:40.642562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606a21-0c8a-4ea5-8ce0-429ecf14ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:40.651182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c85ba-1cda-4452-a327-63e2f20430dc None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:40.651721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c85ba-1cda-4452-a327-63e2f20430dc None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:40.652211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c85ba-1cda-4452-a327-63e2f20430dc None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:40.654004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 231/457] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:40.668288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81964-6811-4e0e-890b-312a8a063bc9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:40.668875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81964-6811-4e0e-890b-312a8a063bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:40.669334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81964-6811-4e0e-890b-312a8a063bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:40.673228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-84606a21-0c8a-4ea5-8ce0-429ecf14ab7a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:40.675033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-84606a21-0c8a-4ea5-8ce0-429ecf14ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:40.696782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-84f81964-6811-4e0e-890b-312a8a063bc9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:40.697985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-84f81964-6811-4e0e-890b-312a8a063bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:40.752750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:40.795599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 227/458] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:40.886704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 232/459] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:40.913707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e4e46-cb51-4c97-a3af-1a9c9f24f57a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:40.914018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e4e46-cb51-4c97-a3af-1a9c9f24f57a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:40.914295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e4e46-cb51-4c97-a3af-1a9c9f24f57a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:40.915656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 228/460] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:40.923372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd3d6-ad6a-4a8e-8061-7b1baeff511f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:40.923829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd3d6-ad6a-4a8e-8061-7b1baeff511f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:40.924262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd3d6-ad6a-4a8e-8061-7b1baeff511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:40.969829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e57dd3d6-ad6a-4a8e-8061-7b1baeff511f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:40.969829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e57dd3d6-ad6a-4a8e-8061-7b1baeff511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:41.120624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9ed60-e105-4765-aa79-daa62d1d6f59 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.120904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9ed60-e105-4765-aa79-daa62d1d6f59 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.121179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9ed60-e105-4765-aa79-daa62d1d6f59 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.122654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 233/461] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:41.122850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 229/462] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:41.128345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c22f-755a-42f9-8e8f-8de1fe85b826 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.128624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c22f-755a-42f9-8e8f-8de1fe85b826 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.128891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c22f-755a-42f9-8e8f-8de1fe85b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.169762 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-3658c22f-755a-42f9-8e8f-8de1fe85b826 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:41.169762 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3658c22f-755a-42f9-8e8f-8de1fe85b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:41.221593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9ed60-e105-4765-aa79-daa62d1d6f59 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.275525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 234/463] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:41.326508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658c22f-755a-42f9-8e8f-8de1fe85b826 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.366428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:41.491842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9ed60-e105-4765-aa79-daa62d1d6f59 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:41.508623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658c22f-755a-42f9-8e8f-8de1fe85b826 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:41.513485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:41.548392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:41.549024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.549302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.549618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.556891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951d56a-0cd7-49b7-b44f-745088e7239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:41.557524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951d56a-0cd7-49b7-b44f-745088e7239e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.558011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951d56a-0cd7-49b7-b44f-745088e7239e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.558418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951d56a-0cd7-49b7-b44f-745088e7239e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.560504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:41.562062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:41.569192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951d56a-0cd7-49b7-b44f-745088e7239e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:41.570780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951d56a-0cd7-49b7-b44f-745088e7239e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:41.576593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:41.577505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:41.578451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:41.578451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.578451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:41.578451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 230/464] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:41.580328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-6951d56a-0cd7-49b7-b44f-745088e7239e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:41.587256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:41.588342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:41.589205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:41.589205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.589205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:41.589205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 235/465] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:41.589735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63161c-26e4-4c75-87f0-9dc6a2c8035b None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.590024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63161c-26e4-4c75-87f0-9dc6a2c8035b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.590296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63161c-26e4-4c75-87f0-9dc6a2c8035b None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.591507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 236/466] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:41.592181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63161c-26e4-4c75-87f0-9dc6a2c8035b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.662785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:41.684628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393492a-7d59-40ab-85f1-7935af8fbb69 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:41.694957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63161c-26e4-4c75-87f0-9dc6a2c8035b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:41.718627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:41.719499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.719769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.720060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.729813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:41.730489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.730667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:41.730779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.731028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.731659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:41.731954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:41.732150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:41.733296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:41.744955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 237/467] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:41.745679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:41.746156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:41.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:41.747846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:41.747846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.747846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:41.747846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 231/468] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:41.748070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.764565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:41.847067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1535-2be3-41ee-9376-6ad32fc7bee8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:41.847727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef780bc-fa09-46fe-b861-2a17e1f94936 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:41.876329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:41.880414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042c54-6f28-49e0-abfd-545410b1894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:41.881009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042c54-6f28-49e0-abfd-545410b1894f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.881277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042c54-6f28-49e0-abfd-545410b1894f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.881536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:41.881648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042c54-6f28-49e0-abfd-545410b1894f None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.882198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042c54-6f28-49e0-abfd-545410b1894f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:41.882291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.882465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.882565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042c54-6f28-49e0-abfd-545410b1894f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:41.882728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.883862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042c54-6f28-49e0-abfd-545410b1894f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:41.892685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:41.894154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:41.900882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 232/469] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:41.902057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a27bd5-cb6a-47bb-af34-5b57d7b84bd5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:41.902340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a27bd5-cb6a-47bb-af34-5b57d7b84bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:41.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a27bd5-cb6a-47bb-af34-5b57d7b84bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:41.909259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:41.910210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:41.915039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:41.915039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:41.915039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:41.915039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 238/470] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:41.915039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.921073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b4a27bd5-cb6a-47bb-af34-5b57d7b84bd5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:41.922417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b4a27bd5-cb6a-47bb-af34-5b57d7b84bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:41.992209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 233/471] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:41.993042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a27bd5-cb6a-47bb-af34-5b57d7b84bd5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:41.996228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:42.016848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d33d-9dff-49a4-95fb-a9dc73008ef8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.055192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.055811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.056087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.056359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.057003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.058542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.082401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 239/472] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:41 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:42.083503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:42.120359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a27bd5-cb6a-47bb-af34-5b57d7b84bd5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.144661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:42.171876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.173095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.173436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.173774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.174840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:42.175205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.176981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.193731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 234/473] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:42.201085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:42.230725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909d4f-184a-471c-927f-c41bea9698b4 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.270923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.271536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.271974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.272223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.272923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.274322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:42.275105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.299404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 240/474] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:42 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:42.300706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:42.319371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6281f-db79-4610-86ae-ffc4eedecfc5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.365104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.365318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.365558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.365846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.366496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:42.366796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.368218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.382737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 235/475] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:42.383943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:42.419483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:42.429288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e91b2-d9bc-4e9a-b1d9-b20731444496 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.479170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.480263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.481254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.481676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.482827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.484819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.504266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917fa33-73d3-415b-ae2b-c4e8566ab891 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.515394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 241/476] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:42 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:42.516843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:42.532798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:42.544848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.545953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.546309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.546698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.547468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.548996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.560469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.sql.core [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:22:42.560469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 09:22:42.560469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [parameters: {'id': '63e50071f0334e79a189c12a81bed2b6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 09:22:42.560469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Sep 30 09:22:42.580042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return ref.to_dict() Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:22:42.581162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application yield resource Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise self.value Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application session.commit() Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:22:42.582316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:22:42.583285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:22:42.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:22:42.584953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [parameters: {'id': '63e50071f0334e79a189c12a81bed2b6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:42.585757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 09:22:42.586612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:42.587456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 30 09:22:42 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:42.589100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:42.671315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24480a8c-6f2a-44d8-adf4-54c875ff6f15 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.721087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.721722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.722044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.722310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.722993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.723496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345121b8-3fd8-4881-9381-532a4f99978b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.724493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.760306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:42 2022] POST /identity/v3/users => generated 249 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:42.776690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714d0d-9a37-4950-84a2-a5c5a3fb6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.777503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714d0d-9a37-4950-84a2-a5c5a3fb6c78 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.777920 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714d0d-9a37-4950-84a2-a5c5a3fb6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.778262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714d0d-9a37-4950-84a2-a5c5a3fb6c78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.792053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0714d0d-9a37-4950-84a2-a5c5a3fb6c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f0714d0d-9a37-4950-84a2-a5c5a3fb6c78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:42.797478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:42.798486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:42.799293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:22:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:42.805425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:42.822190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:42.924313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78895449-dfbf-4c37-9ea6-332f2318c956 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:42.963927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f39169-1726-45a0-a3e0-95845b688fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:42.964570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39169-1726-45a0-a3e0-95845b688fca None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:42.964837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39169-1726-45a0-a3e0-95845b688fca None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:42.965170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39169-1726-45a0-a3e0-95845b688fca None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:42.965899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f39169-1726-45a0-a3e0-95845b688fca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:42.966249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f39169-1726-45a0-a3e0-95845b688fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:42.967643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f39169-1726-45a0-a3e0-95845b688fca None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:42.982724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:44.799912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c3cd0-6634-46e0-8398-e56de2def3bf None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:44.800468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c3cd0-6634-46e0-8398-e56de2def3bf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:44.800468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c3cd0-6634-46e0-8398-e56de2def3bf None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:44.802035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:44.807517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f287c9-3fd7-48d6-a4e4-c8248ad1c0c4 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:44.807934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f287c9-3fd7-48d6-a4e4-c8248ad1c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:44.808089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f287c9-3fd7-48d6-a4e4-c8248ad1c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:44.834866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-76f287c9-3fd7-48d6-a4e4-c8248ad1c0c4 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:44.836082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-76f287c9-3fd7-48d6-a4e4-c8248ad1c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:44.930251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:44.933878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:44.985826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469cf05-185f-41cc-9438-119473232f86 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:44.986102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469cf05-185f-41cc-9438-119473232f86 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:44.986374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469cf05-185f-41cc-9438-119473232f86 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:44.987965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 239/483] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:44.992951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c87c4-5736-4b7b-bc10-c80d1908c031 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:44.993234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c87c4-5736-4b7b-bc10-c80d1908c031 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:44.993508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c87c4-5736-4b7b-bc10-c80d1908c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.016013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a74c87c4-5736-4b7b-bc10-c80d1908c031 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:45.017205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a74c87c4-5736-4b7b-bc10-c80d1908c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:45.102105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 245/484] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:45.267133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3f07-f107-4354-b562-04b102e5317a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.267377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3f07-f107-4354-b562-04b102e5317a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.267595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3f07-f107-4354-b562-04b102e5317a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.268945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 240/485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:45.274693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac805c97-8bbe-4449-9d25-c1ff1085a2e2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.274976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac805c97-8bbe-4449-9d25-c1ff1085a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.275243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac805c97-8bbe-4449-9d25-c1ff1085a2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.300039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ac805c97-8bbe-4449-9d25-c1ff1085a2e2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:45.301278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ac805c97-8bbe-4449-9d25-c1ff1085a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:45.340855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3f07-f107-4354-b562-04b102e5317a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:45.383973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 246/486] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:45.411980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:45.460544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac805c97-8bbe-4449-9d25-c1ff1085a2e2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:45.492897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3f07-f107-4354-b562-04b102e5317a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:45.553606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:45.554300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.554578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.554843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.568897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:45.574187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:45.575109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:45.576314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 241/487] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:45.586036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:45.591083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:45.681178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac805c97-8bbe-4449-9d25-c1ff1085a2e2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:45.718453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6966e-6daa-4a70-b11f-973b15de8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:45.719675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6966e-6daa-4a70-b11f-973b15de8f67 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.719952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6966e-6daa-4a70-b11f-973b15de8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.720222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6966e-6daa-4a70-b11f-973b15de8f67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.725571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66138b57-9e34-4cec-83f7-7fe91d383c71 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:45.730556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6966e-6daa-4a70-b11f-973b15de8f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-70a6966e-6daa-4a70-b11f-973b15de8f67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:45.735974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:45.736885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:45.737684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 247/488] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:45.738856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93a7f-4f94-4c5c-bdfc-93295988b5a3 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.739237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93a7f-4f94-4c5c-bdfc-93295988b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.739521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93a7f-4f94-4c5c-bdfc-93295988b5a3 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.740890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 248/489] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:45.741503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93a7f-4f94-4c5c-bdfc-93295988b5a3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:45.746818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:45.770834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:45.771442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.771721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.772075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.772647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:45.772947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:45.774542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:45.782845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 242/490] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:45.783652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:45.855559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93a7f-4f94-4c5c-bdfc-93295988b5a3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:45.878715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:45.894448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1689-5fa5-4ad1-9932-623edeb6a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:45.895086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1689-5fa5-4ad1-9932-623edeb6a0cd None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.895356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1689-5fa5-4ad1-9932-623edeb6a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.895616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1689-5fa5-4ad1-9932-623edeb6a0cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.898221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada76c17-b122-4870-a290-cedfb15847bf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:45.905628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f1689-5fa5-4ad1-9932-623edeb6a0cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-057f1689-5fa5-4ad1-9932-623edeb6a0cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:45.910381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:45.911274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:45.912058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 249/491] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:45.912716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7026-7931-4a2a-a405-9dec82128a57 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.913109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7026-7931-4a2a-a405-9dec82128a57 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.913207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7026-7931-4a2a-a405-9dec82128a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.931805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-93ab7026-7931-4a2a-a405-9dec82128a57 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:45.932990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-93ab7026-7931-4a2a-a405-9dec82128a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:45.942996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:45.943792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:45.944206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:45.944608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:45.945464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:45.945953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:45.947510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:45.955993 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 243/492] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:45.956974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:45.989011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.006927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 250/493] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:46.010668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7026-7931-4a2a-a405-9dec82128a57 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.069359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf8bc-a8d6-47d2-b3a3-4314592dc5ec None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.104574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4db06d-044e-4a06-b9d4-e4f9a1c67785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.105201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db06d-044e-4a06-b9d4-e4f9a1c67785 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.105472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db06d-044e-4a06-b9d4-e4f9a1c67785 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.105813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db06d-044e-4a06-b9d4-e4f9a1c67785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.111442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7026-7931-4a2a-a405-9dec82128a57 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.116981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4db06d-044e-4a06-b9d4-e4f9a1c67785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.118454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4db06d-044e-4a06-b9d4-e4f9a1c67785 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.122548 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2d4db06d-044e-4a06-b9d4-e4f9a1c67785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:46.134966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:46.135894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:46.136735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:46.136735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.136735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:46.140857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 244/494] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:46.142076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac97960-0912-4b4b-b5e3-137dd2412161 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.142366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac97960-0912-4b4b-b5e3-137dd2412161 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.142715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac97960-0912-4b4b-b5e3-137dd2412161 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.144048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 245/495] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:46.144547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac97960-0912-4b4b-b5e3-137dd2412161 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.161330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.162254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.162532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.162805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.163819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:46.164226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.165492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.179903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 251/496] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:46.179903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.235683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.253215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac97960-0912-4b4b-b5e3-137dd2412161 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.284429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eff15a-1509-43b3-9e9b-3e4bc99ae67f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.285766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5bb08-cb84-4304-be7e-c0e14882eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.286427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5bb08-cb84-4304-be7e-c0e14882eb64 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.286697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5bb08-cb84-4304-be7e-c0e14882eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.286959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5bb08-cb84-4304-be7e-c0e14882eb64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.297634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5bb08-cb84-4304-be7e-c0e14882eb64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.299143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5bb08-cb84-4304-be7e-c0e14882eb64 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d4a5bb08-cb84-4304-be7e-c0e14882eb64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:46.312915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:46.313967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:46.314812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:46.314812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.314812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:46.314812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 246/497] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:46.315238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27707-e54e-49e5-895f-a05082706979 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.315510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27707-e54e-49e5-895f-a05082706979 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.315773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27707-e54e-49e5-895f-a05082706979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.321453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.322089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.322565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.322828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.323455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:46.323746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.325097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.333995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fce27707-e54e-49e5-895f-a05082706979 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:46.335207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fce27707-e54e-49e5-895f-a05082706979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:46.336627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 252/498] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:46.337417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.370162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.404159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 247/499] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:46.409696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27707-e54e-49e5-895f-a05082706979 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.445685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201a15-bf69-48a9-b93f-2778a3f362f4 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.475708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.480642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.481562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.481562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.481870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.492808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.494297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:46.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:46.510084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:46.510951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:46.510951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.510951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:46.510951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 253/500] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:46.511162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.517180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27707-e54e-49e5-895f-a05082706979 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.559048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.559677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.559949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.560345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.570788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.572258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:46.587674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:46.588597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:46.589444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:46.589444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:46.589444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:46.589444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 248/501] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:46.589666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.609282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.628906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331552-01e4-46c6-bd2a-73cd23395d26 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.662895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.663977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.664306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.664657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.665347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:46.665702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.667155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.683840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 254/502] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:46.683840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.697175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c37ff5-8575-4223-8fa1-acbe9088a0d1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.714428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.731632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.732254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.732524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.732785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.741132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.742613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:46.754839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:46.755915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 249/503] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:46.756794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.786202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075321-82f8-4ed9-898e-8d0918fabb8f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.819931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.820527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.820797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.821051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.821686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:46.822007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.823369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.834271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 255/504] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:46.835066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.838517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.860219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c70cb-02e8-4d07-a7f6-13aa165d730c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.896157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.896671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.896940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.897190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.897847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:46.898152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:46.899551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:46.911498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 250/505] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:46.912456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:46.940623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed72d-1397-41c8-b29b-51763e03d177 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:46.954501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:46.974856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:46.975532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:46.975805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:46.976098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:46.987092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:46.992309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:46.993208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:46.994055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 256/506] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:46.994704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.016670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824d9e-2020-401b-aaad-fbbe193c3d12 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.050555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.051175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.051445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.051715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.054567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.058862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.060320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:47.071967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:47.072951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:47.073870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 251/507] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:47.074441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.098923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4cf2-876b-4201-b230-7f57d958953a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.131670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.132272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.132545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.132811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.133527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:47.133855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.135276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.168088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.173337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42397a42-76a6-4604-aa3a-784bfc743647 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.181003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 257/508] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:22:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:47.181854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.208630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.209248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.209527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.209815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.217221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.218910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:47.230337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:47.231223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:47.232113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 252/509] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:47.232666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.289117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa0e63-5c77-4d2a-92ac-342d9b0ecab2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.311802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.324236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.324845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.325118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.325385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.326056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.327501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.330095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92496bf2-75ff-4068-9ff7-18ca35bf95cd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.351647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 258/510] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:22:47 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:22:47.352654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.368021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.368680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.368956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.369221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.369942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:47.370251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.371699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.381288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 253/511] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:47.382197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.411133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.477102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e4be-f9a8-4aa4-aece-3272c48deb29 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.498399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066584da-9336-4c44-8e27-66a11c2c2656 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.516552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.517180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.517455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.517723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.518501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:47.518804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.520273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.539158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 259/512] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:47.540512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.540625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.540771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.541051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.541320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.584512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.628976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.630491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.652183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.661086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb94c0-4bad-48cb-90c9-e8aa6a42e628 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.696477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.697088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.697357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.697621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.698384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:47.698682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.700103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.717663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 260/513] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:47.722739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.744050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 254/514] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:47.744050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.820336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.828448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a6622-926a-4a66-8e84-cc6e88f1e195 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.843816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ba06-7bf1-4256-a8c9-e342afff0de3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:47.863797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:47.866826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.867715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.868160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.868986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.878393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:47.878994 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:47.879271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:47.879541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:47.881378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.882880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:47.898558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:47.899519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:47.900367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:47.900367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:47.900367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:47.900367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 261/515] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:47.900588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:47.954267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:47.955738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.007551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c6875-aa58-496f-889c-b2ec0d9f7d24 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.047135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.047754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.048031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.048365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.057263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 255/516] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:48.058663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.064523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.084844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.119877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.121487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.169377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16042-2382-4c4e-a6ed-a805f54afb87 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.204738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.205366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.205637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.206114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.216896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.218456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.227109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 262/517] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:48.232260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:48.234686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:48.235561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:48.236430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:48.236430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:48.236430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:48.236430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 256/518] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:48.236651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.286901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.313134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.344828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedc005-03af-4166-9f38-de9354cb69ff None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.345015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeef952-58af-4ab1-be65-6fdec77a48e1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.379578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.380206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.380480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.380644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.380750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.381228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.381502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.381766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.382435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:48.382731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.384090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.393171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.394834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.395389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 263/519] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:48.396175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:48.415577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:48.416507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:48.417355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:48.417355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:48.417355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:48.418917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 257/520] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:48.419822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.505896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ba78-0255-49ad-972f-9697094029ab None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.514142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.531169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c780b-6441-45e1-bc70-3c3e58e28d9a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.544890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.545456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.545730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.546029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.554564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.558333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.559781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.565419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.566058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.566336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.566596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.567228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:48.567522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.568875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:48.574811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:48.575722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:48.576804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:48.576804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:48.576804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:48.578409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 264/521] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:48.579345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.590184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 258/522] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:48.590184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.694164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb016-32fb-4b9d-b924-bb88afc312ff None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.700703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc058d-0292-4e0e-8d36-707f9e61e066 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.730646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.731568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.732033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.732315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.736930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.737527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.737827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.738079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.738703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:48.738994 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.740283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.740384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.741737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.752062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 259/523] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:48.753141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:48.754195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:48.755047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 265/524] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:48.758551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.777838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.808944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:48.864006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae50c-a4e9-44cb-a839-4fea7ca54c28 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.868826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55fe5-d7b1-4038-978a-9c8b040a0a86 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:48.897467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.898113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.898419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.898689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.899321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:48.899615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.901002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.905673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:48.906488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:48.906924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:48.907331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:48.912956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 260/525] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:48.914159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:48.919264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:48.920794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:48.933847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:48.934725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 266/526] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:48.940626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.016550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700b411-cfda-4a12-acf2-9b4fa282fe5e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.018837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.023283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.049597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f751726-912e-4ddb-b88c-a229302b1480 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.051413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.052044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.052307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.052568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.059289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.060737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:49.073506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:49.074593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 261/527] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:49.080783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.094863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.095671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.095800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.096020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.096740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:49.097037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.098494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.116568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 267/528] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 30 09:22:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:49.118756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.179936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241414c3-d85c-4e43-b6ec-f9bb6949f628 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.216132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.216877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.217163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.217403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.224673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.225286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b519afb-66c2-45f1-838d-20b7e6789e7c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.226165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:49.238235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:49.247450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 262/529] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:49.250582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.273299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.273944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.274218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.274480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.275162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:49.275459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.276875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.278970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.281844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.301946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 268/530] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:49.301946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.360473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b462d55-549f-4f0b-a1ea-4db03a41b20c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.395770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.396682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.397148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.397421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.398150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:49.398460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.399928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.404240 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d6a7-e3d4-4544-aa72-55aa1a6830cc None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.418183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 263/531] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:49.418183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.447232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.447837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.448133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.448368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.508202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.514696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.523370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.524857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.525935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce281-e77a-4d32-ad44-479dbb38021a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.566941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.567556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.567845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.568073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.569305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:49.569624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.571594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.584553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 264/532] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:49.585369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.651154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 269/533] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:49.651154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.689281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249366-79c6-4b15-a64b-e7f7fce441c6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.721585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.722210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.722479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.722740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.723447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=e45d799ba78f4adc82f3ffdc9293ff20) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:49.723744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.725210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.730594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 265/534] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/role_assignments?user.id=e45d799ba78f4adc82f3ffdc9293ff20&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:49.731316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.745832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.748262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:49.753390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7585a-9844-4f3c-8977-372dc2fdbb9b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.793485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ec52e-bec1-4f1d-8602-171b21b21bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.794142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec52e-bec1-4f1d-8602-171b21b21bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.794505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec52e-bec1-4f1d-8602-171b21b21bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.794770 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec52e-bec1-4f1d-8602-171b21b21bf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.795524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ec52e-bec1-4f1d-8602-171b21b21bf5 None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=b7c18108a06141b5b501241b919663bb) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:49.795828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ec52e-bec1-4f1d-8602-171b21b21bf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.797356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ec52e-bec1-4f1d-8602-171b21b21bf5 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.813906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 270/535] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/role_assignments?user.id=b7c18108a06141b5b501241b919663bb&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:49.813906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8524ea-53fc-43bd-a687-632058630f41 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.813906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8524ea-53fc-43bd-a687-632058630f41 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.813906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8524ea-53fc-43bd-a687-632058630f41 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.813906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 271/536] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:49.813906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8524ea-53fc-43bd-a687-632058630f41 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:49.870710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951539-897b-4e23-a59c-b5a132243aac None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.924895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ec42-a070-4358-b239-c7dca5e377b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.926215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ec42-a070-4358-b239-c7dca5e377b5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.926689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ec42-a070-4358-b239-c7dca5e377b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.927163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ec42-a070-4358-b239-c7dca5e377b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.928110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ec42-a070-4358-b239-c7dca5e377b5 None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=b77625f61bca4548af4cd5702d2b807a) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:49.928604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ec42-a070-4358-b239-c7dca5e377b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:49.931756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ec42-a070-4358-b239-c7dca5e377b5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:49.939477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 266/537] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/role_assignments?user.id=b77625f61bca4548af4cd5702d2b807a&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:49.941785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd39f-a6db-4b07-819a-fd653797edda None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.942488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd39f-a6db-4b07-819a-fd653797edda None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.943350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd39f-a6db-4b07-819a-fd653797edda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:49.947036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8524ea-53fc-43bd-a687-632058630f41 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:49.968745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-715cd39f-a6db-4b07-819a-fd653797edda None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:49.970920 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-715cd39f-a6db-4b07-819a-fd653797edda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:49.990015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:49.990689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:49.990966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:49.991239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:50.024255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:50.026100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:50.044238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:50.045328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:50.046220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:50.046220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:50.046220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:50.046220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 272/538] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:50.051685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:50.065858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 267/539] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:50.075849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:50.174411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe895-be03-40df-aba8-bb1649787cca None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:50.211323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:50.211922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:50.212199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:50.212468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:50.213111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:50.213412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:50.214922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:50.228458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 273/540] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:50.233707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cd39f-a6db-4b07-819a-fd653797edda None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:50.241844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:50.399624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cd39f-a6db-4b07-819a-fd653797edda None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:50.408318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:50.465284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:50.465866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:50.466142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:50.466406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:50.480063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:50.483068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:50.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:50.504722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:50.505548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 268/541] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:50.511745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:50.512466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:50.568248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab92ac-2bca-4651-970a-152c4ff60367 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:50.583416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:50.627614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84635f40-f290-4931-b860-cc33901aaf25 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:50.661392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:50.662066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:50.662348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:50.662606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:50.664687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:50.665292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:50.665629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:50.665938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:50.666892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:50.667207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:50.668742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:50.682008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 269/542] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:50.690811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:50.691746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:50.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:50.702222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:50.703101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:50.707836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 274/543] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:50.710834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:50.863039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d498-7acf-40bd-9b91-780a2373a64a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:50.873297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ccb8-6fac-41e7-bf06-c32792181dec None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:50.905074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:50.913037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:50.914186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:50.916311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:50.917443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:50.917935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:50.918978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:50.920596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:50.923202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:50.936063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:50.938028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:50.940230 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 275/544] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:50.940739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:50.941201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:50.942150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=c89d986ea1b3488a8873b2e0e87b1ce5) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:50.942670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:50.944330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:50.946024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:50.952150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 270/545] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:50 2022] GET /identity/v3/role_assignments?user.id=c89d986ea1b3488a8873b2e0e87b1ce5&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:51.072081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c476ad-d805-4840-bc23-ba39f432852f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:51.110831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:51.111494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:51.111771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:51.112041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:51.123984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:51.126062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:51.142242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:51.143218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:51.144064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:51.144064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:51.144064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:51.144064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 276/546] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:51.149681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:51.302694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21eba-be5e-4c6e-911c-6e0684c2a065 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:51.345603 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:51.346259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:51.346535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:51.346800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:51.347509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:51.347810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:51.349277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:51.362914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 271/547] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:51.370951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:51.437894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:51.501049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893a1b8-20b2-4b85-883b-a1f1d7bd4872 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:51.547255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:51.547948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:51.548229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:51.548554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:51.559937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:51.561402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:51.579095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:51.580562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:51.581652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 277/548] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:51.586243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:51.637007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:51.694294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80251-47ca-45c1-be8b-0c4216d383be None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:51.729745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:51.730463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:51.730746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:51.731067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:51.731840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:51.732145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:51.733597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:51.773047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 272/549] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 30 09:22:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:51.778701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:51.910161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa72169-edc9-4a36-9570-810c48b4d948 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:51.918341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:51.956415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:51.956946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:51.957222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:51.957490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.032576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:52.034080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:52.133468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 278/550] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:22:52.138869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:52.324235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c5ab-6456-49d1-93af-69dbb5143bb2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:52.328514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:52.362210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd94d7-9a2b-48eb-9f52-afb2eb637cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:52.363252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd94d7-9a2b-48eb-9f52-afb2eb637cff None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.363729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd94d7-9a2b-48eb-9f52-afb2eb637cff None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.364193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd94d7-9a2b-48eb-9f52-afb2eb637cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.374925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd94d7-9a2b-48eb-9f52-afb2eb637cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:52.376726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd94d7-9a2b-48eb-9f52-afb2eb637cff None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-97fd94d7-9a2b-48eb-9f52-afb2eb637cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:52.392420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:52.393507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:52.394445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:52.394445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:52.394445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:52.396597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 273/551] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:52.402932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:52.411403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:52.490770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ff3f-0635-4fa8-985f-68e8ab0c5177 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.491409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ff3f-0635-4fa8-985f-68e8ab0c5177 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.491877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ff3f-0635-4fa8-985f-68e8ab0c5177 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.493560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 274/552] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:22:52.511225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6ce90-fb2d-4536-90a5-a545adbba47e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.511527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6ce90-fb2d-4536-90a5-a545adbba47e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.511772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6ce90-fb2d-4536-90a5-a545adbba47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.547146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa84f2-282e-4937-a4aa-0a424e8cc83f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:52.549731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fde6ce90-fb2d-4536-90a5-a545adbba47e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:52.551820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fde6ce90-fb2d-4536-90a5-a545adbba47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:52.586356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951374e-d58b-4c0f-aa08-df8a4f954159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:52.587410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951374e-d58b-4c0f-aa08-df8a4f954159 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.587805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951374e-d58b-4c0f-aa08-df8a4f954159 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.588077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951374e-d58b-4c0f-aa08-df8a4f954159 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.588727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951374e-d58b-4c0f-aa08-df8a4f954159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:52.589016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951374e-d58b-4c0f-aa08-df8a4f954159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:52.590533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951374e-d58b-4c0f-aa08-df8a4f954159 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:52.603335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 279/553] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:52.604641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1d29-e085-47a4-bddc-60c3bd74e377 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.604924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1d29-e085-47a4-bddc-60c3bd74e377 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.605466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1d29-e085-47a4-bddc-60c3bd74e377 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.607674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 280/554] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:52.611874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf1d29-e085-47a4-bddc-60c3bd74e377 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:52.634761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 275/555] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:52.637288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51815-e0a4-4f95-adf1-ffd6457ed05a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.637721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51815-e0a4-4f95-adf1-ffd6457ed05a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.638389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51815-e0a4-4f95-adf1-ffd6457ed05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.664706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-77b51815-e0a4-4f95-adf1-ffd6457ed05a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:52.666437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-77b51815-e0a4-4f95-adf1-ffd6457ed05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:52.732584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:52.778091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 276/556] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:52.779560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2422a-a7c9-4d64-8080-fba682d36694 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.779835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2422a-a7c9-4d64-8080-fba682d36694 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.780099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2422a-a7c9-4d64-8080-fba682d36694 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.782266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf1d29-e085-47a4-bddc-60c3bd74e377 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:52.785536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 277/557] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:52.790981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4138-bff0-42f6-8dd5-1be66589d959 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.791258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4138-bff0-42f6-8dd5-1be66589d959 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.791520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4138-bff0-42f6-8dd5-1be66589d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.817728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:52.818419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:52.819179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:52.819461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:52.826451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:52.827918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:52.834910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-67ca4138-bff0-42f6-8dd5-1be66589d959 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:52.836324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-67ca4138-bff0-42f6-8dd5-1be66589d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:52.839362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:52.840198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:52.841054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 281/558] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:52.853816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:52.861821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:52.952445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486621a7-acd7-40b3-b267-b7b94a0076ee None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:52.966197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 278/559] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:52.967169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4138-bff0-42f6-8dd5-1be66589d959 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:52.995946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:53.011012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.011620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.012110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.012256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.012826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:53.013125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.014585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.041991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 282/560] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:53.048160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.123541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4138-bff0-42f6-8dd5-1be66589d959 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.168215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.168859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.169376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.169655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.171179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83333150-340c-4113-a480-3d0b23bb192c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.182032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:53.188768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:53.189700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:53.190563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 279/561] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:53.191619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.203185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:53.216940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.217894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.218396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.218861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.219785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=861b64b65d2642afbacfa20851257333) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:53.220308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.222152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.229602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 283/562] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/role_assignments?user.id=861b64b65d2642afbacfa20851257333&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:53.230724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.289153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:53.346236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b17a-bd0c-4bb2-9dd4-6735da3bab9d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.355907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dbeeb-db79-40a2-b5cc-5f1924d4386e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.400225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.400774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.401009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.401275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.401984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:53.402250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.402367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.403184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.403652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.403865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.404315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.418280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:53.418480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 284/563] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:53.419322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:53.425484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:53.426517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:53.427448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:53.436124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 280/564] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:53.436124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.508463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:53.545081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab18ffb-8383-415a-8245-86382172ad98 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.550816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04304bf6-e4bf-492b-b3d6-9f60a567b33b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.565821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:53.585068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.585838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.586119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.586481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.600675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.601331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.601598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:53.601706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.601907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:53.607807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:53.608869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:53.609718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:53.616385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 285/565] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:53.617439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.617622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.622061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:53.639379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:53.641739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:53.643127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:53.643127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:53.643127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:53.643127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 281/566] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:53.643127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.737374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa778c6-a707-49a5-a242-7021863afc1e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.748718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a4ce4-a71b-493d-a3e0-a337f079040c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.767748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:53.773897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.774504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.774765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.775020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.775696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:53.775978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.777368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.785926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 286/567] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:53.786712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.792085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d10e1e-85bc-498a-80a5-2e9d71d0351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.792701 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d10e1e-85bc-498a-80a5-2e9d71d0351f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.793030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d10e1e-85bc-498a-80a5-2e9d71d0351f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.793335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d10e1e-85bc-498a-80a5-2e9d71d0351f None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.794019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d10e1e-85bc-498a-80a5-2e9d71d0351f None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:53.794320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d10e1e-85bc-498a-80a5-2e9d71d0351f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.795693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d10e1e-85bc-498a-80a5-2e9d71d0351f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.804907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 282/568] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:53.806334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbfd90-e832-43a5-a136-96a2a9a1f9ac None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.806567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbfd90-e832-43a5-a136-96a2a9a1f9ac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.806862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbfd90-e832-43a5-a136-96a2a9a1f9ac None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.809923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 283/569] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:53.809923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbfd90-e832-43a5-a136-96a2a9a1f9ac None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.828764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:53.899179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1ad7-ce3f-436c-acfb-6cf3c4f44e40 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.921747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbfd90-e832-43a5-a136-96a2a9a1f9ac None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:53.933586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.934222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.934495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.934757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.935397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:53.935696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.937164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.948591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 287/570] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:53.949403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:53.964230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7739f2-8669-4836-9069-50afb224e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:53.964934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7739f2-8669-4836-9069-50afb224e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.965270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7739f2-8669-4836-9069-50afb224e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.965597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7739f2-8669-4836-9069-50afb224e3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:53.976639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7739f2-8669-4836-9069-50afb224e3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:53.978215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7739f2-8669-4836-9069-50afb224e3e3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-0c7739f2-8669-4836-9069-50afb224e3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:53.994162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:53.995103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:53.996000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:53.996000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:53.996000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:53.996798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 284/571] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:53.998094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd823f3-a60a-4d32-8518-b49484612bfe None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:53.998369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd823f3-a60a-4d32-8518-b49484612bfe None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:53.998634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd823f3-a60a-4d32-8518-b49484612bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.020802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1fd823f3-a60a-4d32-8518-b49484612bfe None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:54.022287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1fd823f3-a60a-4d32-8518-b49484612bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:54.046909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.053012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.056211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d43ea-7b2f-40b9-9887-e70552318679 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.090217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.091184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.091685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.092011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.101990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 285/572] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:54.101990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd823f3-a60a-4d32-8518-b49484612bfe None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.105863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.107322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:54.121576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:54.122591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:54.123575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:54.123575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:54.123575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:54.127364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 288/573] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:54.128286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.230058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fad88-76a4-4f52-9198-c53607c87454 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.238423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd823f3-a60a-4d32-8518-b49484612bfe None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.265337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.266231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.266917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.267781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.268941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:54.269410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.271371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.279043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.279737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.280069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.280395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.286285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 289/574] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:54.287282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.289301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.291341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.297907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:54.306452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:54.307448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:22:54.308374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:54.309876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 286/575] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:54.310862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.346653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.414759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6d814-1b0f-4418-84b5-880704a692f2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.434336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794947-35dd-46a1-b55c-6850156a1b22 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.451996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.452624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.452894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.453158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.453780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:54.454103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.455486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.467130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 290/576] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:54.470775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.471757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.472452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.472874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.473127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.481492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.483304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:54.495223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:54.496159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:54.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:54.497694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.543886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.581563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bcc61-7898-4ba1-89b3-27b627ca0397 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.586098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.605390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2fbc-229c-42e7-b32f-ee6a08c75268 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.624796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.625486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.625854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.626186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.626970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:54.627333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.628764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.645172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.645825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.646175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.646438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.647611 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 291/578] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:54.650698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.658366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:54.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:54.665707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:54.666569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 288/579] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:54.667261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.765943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e874a8-1a82-4522-8f00-36bd568ea7b5 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.768756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ff3a-6e68-4530-9f50-451f560df39e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.790979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.802982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.803162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.803518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.803621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.803811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.803916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.804070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.804159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.804816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:54.805162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.806980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.811347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.812871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.821154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:54.824392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:54.825317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:22:54.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:54.830019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 289/580] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:54.830777 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 292/581] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:54.831002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.831926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.931742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf01bf-d44b-4097-a0ec-c88607dc29e4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.940483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e36ee-7b01-478e-983f-c3887c16fbd4 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:54.964613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.965239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.965517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.965779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.976292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.977742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.978406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:54.979236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:54.979728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:54.980304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:54.980980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:54.981268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:54.982648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:54.995877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 293/582] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:54.995877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:54.996153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:54.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:54.998890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:54.998890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:54.998890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:54.998890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 290/583] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:54.998890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.048368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.049768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.106987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfda43-c0e6-4fc9-99a8-24a50b39e53c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.109411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3868e-910a-462b-8432-ab3e0c9688c0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.143556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.143778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.144155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.144259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.144418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.144513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.144674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.144766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.145568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:55.145905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.147825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.155383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.157345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.173114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 291/584] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:55.173114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:55.174177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:55.175091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:55.175998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:55.175998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:55.175998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:55.177922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 294/585] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:55.178717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.276599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.281023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252f135-fcdd-4f48-b1b1-368014a92492 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.281415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0abfae-ce14-42e9-a9b0-db46ffbc8ff9 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.292677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.318697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.318932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.319417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.319523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.319689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.319786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.319951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.320056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.320607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:55.320910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.322393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.331963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.333491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.340656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 295/586] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:55.340656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:55.350099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:55.351448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:55.352460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:55.352460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:55.352460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:55.352460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 292/587] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:55.352460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.449644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28f5e-2248-407c-b6f7-260ba56354b9 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.456322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c8aa-64d7-40e9-896a-16a54845330c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.483154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.483904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.484307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.484616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.490545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.491148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.491418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.491683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.492319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:55.492617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.494084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.495172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.496639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.506243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 293/588] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:55.507045 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:55.510905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:55.512041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:55.513243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:55.513243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:55.513243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:55.513243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 296/589] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:55.513243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.526704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.534279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.607791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec249-bc06-4bf0-82cc-bdb930e15ed7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.613050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818753-a83f-4adb-afad-1d0682ac8ce2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.646240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79702030-f8d1-407c-b812-61839b98226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.646867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79702030-f8d1-407c-b812-61839b98226c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.647162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79702030-f8d1-407c-b812-61839b98226c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.647428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79702030-f8d1-407c-b812-61839b98226c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.648289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38157fef-b6c0-4d87-80bf-3ace4320f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.648890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157fef-b6c0-4d87-80bf-3ace4320f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.649162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157fef-b6c0-4d87-80bf-3ace4320f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.649421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157fef-b6c0-4d87-80bf-3ace4320f3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.650086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38157fef-b6c0-4d87-80bf-3ace4320f3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:55.650377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38157fef-b6c0-4d87-80bf-3ace4320f3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.651750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38157fef-b6c0-4d87-80bf-3ace4320f3f6 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.653970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79702030-f8d1-407c-b812-61839b98226c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.655415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79702030-f8d1-407c-b812-61839b98226c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.663966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 297/590] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:55.665105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1b24-52c0-403e-b988-2e6ed85d86dd None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.665450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1b24-52c0-403e-b988-2e6ed85d86dd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.665713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1b24-52c0-403e-b988-2e6ed85d86dd None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.667049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 298/591] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-79702030-f8d1-407c-b812-61839b98226c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:55.667152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:55.667964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:55.668857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:55.669313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1b24-52c0-403e-b988-2e6ed85d86dd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.671820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 294/592] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:55.671820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79702030-f8d1-407c-b812-61839b98226c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.740257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.750858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.769517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79702030-f8d1-407c-b812-61839b98226c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.771531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1b24-52c0-403e-b988-2e6ed85d86dd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.802695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.803295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.803568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.803833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.804263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e0023-a048-4b8d-90e5-ea0ef23e9704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.804490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:55.804790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.804880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e0023-a048-4b8d-90e5-ea0ef23e9704 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.805143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e0023-a048-4b8d-90e5-ea0ef23e9704 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.805407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e0023-a048-4b8d-90e5-ea0ef23e9704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.806200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.811888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e0023-a048-4b8d-90e5-ea0ef23e9704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.813299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e0023-a048-4b8d-90e5-ea0ef23e9704 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.817646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 295/593] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:55.818459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-098e0023-a048-4b8d-90e5-ea0ef23e9704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:55.825265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:55.826239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:55.827109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 299/594] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:55.827800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a26c8d-02b7-4adf-935f-1b5d20b40cea None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.827800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a26c8d-02b7-4adf-935f-1b5d20b40cea None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.828007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a26c8d-02b7-4adf-935f-1b5d20b40cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.845244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-09a26c8d-02b7-4adf-935f-1b5d20b40cea None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:55.846475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-09a26c8d-02b7-4adf-935f-1b5d20b40cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:55.910250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 300/595] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:55.911097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a26c8d-02b7-4adf-935f-1b5d20b40cea None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.917623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937630cc-a791-457f-a30e-a34edbd2c1f8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:55.954529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:55.955185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:55.955460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:55.955722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:55.962803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:55.964256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:55.975795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:55.976733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 296/596] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:55.977662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:55.980268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:55.988705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.034380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a26c8d-02b7-4adf-935f-1b5d20b40cea None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.072095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.072794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.073056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.073315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.074025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:56.074327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.075746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.083654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565bbba-3cf5-486f-be4e-3f6570feb1a4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.092492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 301/597] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:56.092492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.122399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.123068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.123392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.123810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.130631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.132074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:56.143064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:56.143957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 297/598] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:56.149773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.199752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ff5a7-0b69-484f-9a29-7f517b8d36d1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.209294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.219125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.233700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.234488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.234765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.235033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.235721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:56.236022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.237445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.247307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df543f-fd1f-4408-9288-9ccf36f32f6d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.248907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 302/599] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:56.249701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.281248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.281922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.282199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.282469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.283183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:56.283481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.284977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.303968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 298/600] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 30 09:22:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:56.304787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.346874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de879-2dc6-4261-9519-050dff17bd5a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.379932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.380594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.380865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.381128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/b7c18108a06141b5b501241b919663bb/roles/d7d221ea917b4de09e35c98f4ecc0b9e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.395499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=b7c18108a06141b5b501241b919663bb, role_id=d7d221ea917b4de09e35c98f4ecc0b9e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.396949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.408123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53c65d-81ec-4a69-9bff-d5ea9c88deaa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.410898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 303/601] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:56 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/b7c18108a06141b5b501241b919663bb/roles/d7d221ea917b4de09e35c98f4ecc0b9e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:56.411697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.439219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.451995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.456543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.457279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.457490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.457757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.458499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:56.458804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.460341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.474490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 299/602] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:56.475345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.535110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16dfbe-be4b-4bfa-bd35-6a18939c67b1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.573047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.574006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.574348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.574717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.587660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:56.592601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:56.593785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:56.594887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:56.595612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ac2bc-e668-4e94-bf09-b5a0fa506839 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.595706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 304/603] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:56.595889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.637512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.638464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.638710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.639041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/b77625f61bca4548af4cd5702d2b807a/roles/d7d221ea917b4de09e35c98f4ecc0b9e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.653852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=b77625f61bca4548af4cd5702d2b807a, role_id=d7d221ea917b4de09e35c98f4ecc0b9e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.655402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.670504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 300/604] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:56 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/b77625f61bca4548af4cd5702d2b807a/roles/d7d221ea917b4de09e35c98f4ecc0b9e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:56.678031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.714406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.733081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.754348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4b928-2f28-4ff6-a452-83bdb5c388b3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.800893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c888d-06b6-48a0-ab29-9861de038b30 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:56.809178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.810730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.811179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.811596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.826336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.828767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.841344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:56.841903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:56.842276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:56.842660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/e45d799ba78f4adc82f3ffdc9293ff20/roles/d7d221ea917b4de09e35c98f4ecc0b9e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:56.849682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:56.850892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:56.851966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:56.851966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:56.851966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:56.853742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 305/605] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:56.855717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.864484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=e45d799ba78f4adc82f3ffdc9293ff20, role_id=d7d221ea917b4de09e35c98f4ecc0b9e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:56.866202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:56.883943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 301/606] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:56 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/e45d799ba78f4adc82f3ffdc9293ff20/roles/d7d221ea917b4de09e35c98f4ecc0b9e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:56.884783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:56.994163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:56.996148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8081-d768-46db-a327-f285eb7e436b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.014747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e91888-a2dc-4f4d-9950-ab4ba49d72f0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.033859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:57.034456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:57.034768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:57.035037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:57.035817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:57.036116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:57.037860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:57.048324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 306/607] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:57.055535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:57.064128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:57.073372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:57.074378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:57.074836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:57.075266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:57.076083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:57.076566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:57.080406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:57.108929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 302/608] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:57.118877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:57.223808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42797525-cd0c-462f-9fc7-133a3b6c4207 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.262736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:57.263370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:57.263644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:57.263907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:57.265012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d79ff-d4a3-4adb-a0ae-1c571cc716e9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.286809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:57.288653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:57.315705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:57.316764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:57.317639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:57.317639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:57.317639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:57.317639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 307/609] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:57.322607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:57.323297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:57.323574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:57.323837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:57.326572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:57.339803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:57.341295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:57.347937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:57.366198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:57.367192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:57.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:57.381311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 303/610] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:57.395216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:57.426664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:57.473978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592278ac-0674-4536-bd34-dc0896ca396a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.508308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:57.508901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:57.509174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:57.509439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:57.510109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:57.510406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:57.511893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:57.524737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 308/611] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:57.532575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:57.653863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbd668-07ca-4793-bb16-3aa3ec12e6c5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.710048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9387a2-d7fc-46bb-8096-970866cb0e28 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.728884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:57.729502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:57.729765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:57.730056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:57.730831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:57.731133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:57.732586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:57.757364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:57.761505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 304/612] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:57.765918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:57.782030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:57.782675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:57.782966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:57.783233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:57.799584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:57.801913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:22:57.826861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:57.828050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:22:57.829120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:57.831395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 309/613] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:22:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:57.837173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:57.887230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:57.958736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d0ff-26aa-4668-ba34-5bfb0cf6d7d3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:57.999886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2e227-9a8a-4e33-a50a-109c42dc85d3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:58.022436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:58.022805 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:58.023086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:58.023345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/c89d986ea1b3488a8873b2e0e87b1ce5/roles/d7d221ea917b4de09e35c98f4ecc0b9e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:58.038105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:58.039376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:58.039809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:58.040225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:58.041093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:58.041550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:58.043142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:58.054083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=c89d986ea1b3488a8873b2e0e87b1ce5, role_id=d7d221ea917b4de09e35c98f4ecc0b9e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:58.055517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:58.062891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 310/614] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 30 09:22:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:22:58.074896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:58.080911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 305/615] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:57 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/c89d986ea1b3488a8873b2e0e87b1ce5/roles/d7d221ea917b4de09e35c98f4ecc0b9e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:58.130106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:58.226291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6499a-65c1-4acb-99e7-e48d6774ad9d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:58.277062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:58.277731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:58.277977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:58.278277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:58.289971 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:58.291426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:22:58.307982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:58.309046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:22:58.310000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:22:58.310000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:22:58.310000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:58.310000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 311/616] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:58.315230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:58.425551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f9ab3-4a01-4fdd-bd97-facee2628335 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:58.436566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:58.475428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:58.476043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:58.476370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:58.476583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:58.477212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:58.477506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:58.479022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:58.496725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 306/617] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:58.502330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:58.603984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:58.625869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d827fa-6090-471d-99f5-0897f393a1a8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:58.681202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:58.681857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:58.682139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:58.682407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:58.690055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:58.691503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:22:58.703588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:58.704677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:58.706052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 312/618] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:22:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:22:58.710567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:58.844084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcbe52-3049-48f4-81bf-8b97aeed7058 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:58.887356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf9d2e-f0aa-4c59-86c6-dc50c8b9e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:58.888019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf9d2e-f0aa-4c59-86c6-dc50c8b9e8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:58.888293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf9d2e-f0aa-4c59-86c6-dc50c8b9e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:58.888558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf9d2e-f0aa-4c59-86c6-dc50c8b9e8f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:58.889247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf9d2e-f0aa-4c59-86c6-dc50c8b9e8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:22:58.889549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf9d2e-f0aa-4c59-86c6-dc50c8b9e8f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:58.891239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf9d2e-f0aa-4c59-86c6-dc50c8b9e8f7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:58.907428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 307/619] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:22:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:22:58.913727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:59.053788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7946f-474c-41c4-a447-c37ec8741bdc None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:59.100048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdad8a-f8f4-4dc2-bf50-be5a6707ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:59.100651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdad8a-f8f4-4dc2-bf50-be5a6707ea0a None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.100924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdad8a-f8f4-4dc2-bf50-be5a6707ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.101189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdad8a-f8f4-4dc2-bf50-be5a6707ea0a None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/861b64b65d2642afbacfa20851257333/roles/d7d221ea917b4de09e35c98f4ecc0b9e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.127286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdad8a-f8f4-4dc2-bf50-be5a6707ea0a None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=861b64b65d2642afbacfa20851257333, role_id=d7d221ea917b4de09e35c98f4ecc0b9e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:22:59.128755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdad8a-f8f4-4dc2-bf50-be5a6707ea0a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:22:59.132168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:59.163722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 313/620] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:22:58 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/861b64b65d2642afbacfa20851257333/roles/d7d221ea917b4de09e35c98f4ecc0b9e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:22:59.208729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5e7d-13d5-4edd-8aef-70a2d719cf7d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.209090 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5e7d-13d5-4edd-8aef-70a2d719cf7d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.209260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5e7d-13d5-4edd-8aef-70a2d719cf7d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.211196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 308/621] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:59.217723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07229f39-323d-4b9b-b73c-89610f8a49ec None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.218144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07229f39-323d-4b9b-b73c-89610f8a49ec None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.218542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07229f39-323d-4b9b-b73c-89610f8a49ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.238460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-07229f39-323d-4b9b-b73c-89610f8a49ec None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:59.239776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-07229f39-323d-4b9b-b73c-89610f8a49ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:59.320468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f21e-357f-4f1e-86a7-7e5657a6cc10 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.320468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f21e-357f-4f1e-86a7-7e5657a6cc10 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.320468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f21e-357f-4f1e-86a7-7e5657a6cc10 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.321478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 309/622] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:59.322934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 314/623] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:59.328382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd130-4ce3-47fa-a240-7a5905f101ce None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.329044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd130-4ce3-47fa-a240-7a5905f101ce None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.329530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd130-4ce3-47fa-a240-7a5905f101ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.350834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-89fcd130-4ce3-47fa-a240-7a5905f101ce None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:59.352394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-89fcd130-4ce3-47fa-a240-7a5905f101ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:59.379580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:59.437078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 310/624] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:22:59.562560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3fe91-c4d4-4338-95ee-f63d1fd23b12 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.563181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3fe91-c4d4-4338-95ee-f63d1fd23b12 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.563181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3fe91-c4d4-4338-95ee-f63d1fd23b12 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.564567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 315/625] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:22:59.570208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a126-0b67-4fc4-abc9-0f18de248ff7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.570736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a126-0b67-4fc4-abc9-0f18de248ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.571221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a126-0b67-4fc4-abc9-0f18de248ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.593266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6214a126-0b67-4fc4-abc9-0f18de248ff7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:22:59.594949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6214a126-0b67-4fc4-abc9-0f18de248ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:22:59.672880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3fe91-c4d4-4338-95ee-f63d1fd23b12 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:59.702048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 311/626] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:22:59.717981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a126-0b67-4fc4-abc9-0f18de248ff7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:59.788827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3fe91-c4d4-4338-95ee-f63d1fd23b12 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:59.818177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:59.830765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:59.831412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.831688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.831959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.843679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:22:59.845328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:59.851909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:59.852874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:22:59.853717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 316/627] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:59.861851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:22:59.866125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a126-0b67-4fc4-abc9-0f18de248ff7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:22:59.926532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:22:59.927074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:22:59.927350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:22:59.927604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:22:59.948211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:22:59.954533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:22:59.955461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:22:59.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:22:59.956924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 312/628] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:22:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:22:59.962481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.021670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3d2e0-e70d-4d07-9ef1-4929277f98a8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.055933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.056533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.056802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.057064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.057713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:00.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.059408 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.067932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 317/629] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:00.068756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.117600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.118784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174334e-a268-4be0-aa05-4b51102cb5c6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.156854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.157459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.157731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.158117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.158781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:00.159081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.160477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.170088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 313/630] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:22:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:00.170227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31553eed-4e4d-4b5a-9ef6-3af52d2946ee None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.170893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.186868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.206496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.207141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.207415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.207683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.219049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:00.224404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:00.225518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:00.226588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 318/631] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:00.227312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.286308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af22bf-ce0a-4063-915a-3aa33d0cbbaf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.329923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.330573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.330855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.331116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.336622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10624edc-bb90-488d-bc9f-ec8ab599d906 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.345262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.347260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.347868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:00.365696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:00.366923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:00.367951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:00.367951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:00.367951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:00.369332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 314/632] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:00.370274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.386453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.387102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.387380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.387652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.401194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.403344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:00.421355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:00.422634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:00.423557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:00.423557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:00.423557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:00.427233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 319/633] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:00.428097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.449262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.504259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084842cf-d5e5-44f8-a4ed-2c66a263acc8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.546483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e51c48-0cab-4ac9-b4c3-5742044753c3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.549005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.549622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.549931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.551004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.551679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:00.551978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.553365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.565881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 315/634] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:00.567127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.596406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.597129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.597312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.597583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.598274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:00.598580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.600508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.621015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 320/635] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:00.622036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.647981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.698470 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf850a-5fde-4d18-a49b-5570302b6e61 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.728267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.739819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.740422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.740694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.740870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c013-71df-4fb8-a1bb-fd720dfcd4ba None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.740979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.741572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:00.741903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.743522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.756099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 316/636] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:00.757022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.779523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798239e-9475-4aaa-b0d9-a0fdd2dd974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.780146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798239e-9475-4aaa-b0d9-a0fdd2dd974d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.780449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798239e-9475-4aaa-b0d9-a0fdd2dd974d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.780822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798239e-9475-4aaa-b0d9-a0fdd2dd974d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.792394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798239e-9475-4aaa-b0d9-a0fdd2dd974d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.794392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798239e-9475-4aaa-b0d9-a0fdd2dd974d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-d798239e-9475-4aaa-b0d9-a0fdd2dd974d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:00.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:00.813468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:00.814398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:00.814398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:00.814398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:00.814398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 321/637] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:00.815198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad4c34-bf2b-43cb-9f01-a075a1fd5a00 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.815198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad4c34-bf2b-43cb-9f01-a075a1fd5a00 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.815377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad4c34-bf2b-43cb-9f01-a075a1fd5a00 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.816430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 322/638] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:00.817101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad4c34-bf2b-43cb-9f01-a075a1fd5a00 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.867872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c4272-bfe5-4a08-91ae-b86f58a3c373 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.894547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.904776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.905924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.906390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.906774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.914945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.916388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.927872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad4c34-bf2b-43cb-9f01-a075a1fd5a00 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:00.928007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:00.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 317/639] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:00.929958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:00.972044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdb8ed-2574-4e57-8362-d0148b007e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:00.972677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdb8ed-2574-4e57-8362-d0148b007e42 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:00.973251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdb8ed-2574-4e57-8362-d0148b007e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:00.973518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdb8ed-2574-4e57-8362-d0148b007e42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:00.976534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:00.982471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdb8ed-2574-4e57-8362-d0148b007e42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:00.984373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdb8ed-2574-4e57-8362-d0148b007e42 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1abdb8ed-2574-4e57-8362-d0148b007e42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:00.995540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:00.996531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:00.997475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:01.001294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 323/640] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:01.002615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75ed4-f3aa-447a-a5c3-5927ea8ce963 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.002784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75ed4-f3aa-447a-a5c3-5927ea8ce963 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.003051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b75ed4-f3aa-447a-a5c3-5927ea8ce963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.021154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-14b75ed4-f3aa-447a-a5c3-5927ea8ce963 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:01.022501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-14b75ed4-f3aa-447a-a5c3-5927ea8ce963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:01.034722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0e91-27dd-4bce-b15a-13cb20da7820 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.069458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.070201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.070474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.070740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.071371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:01.071668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.073033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.085011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 318/641] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:01.085788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.098028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 324/642] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:23:01.106091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75ed4-f3aa-447a-a5c3-5927ea8ce963 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.165534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.197779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e418f9d-8a30-43d5-8b41-80c3a550d839 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.211538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b75ed4-f3aa-447a-a5c3-5927ea8ce963 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.214102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.235284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.235814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.236083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.236372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.237162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:01.237463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.238954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.252725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.253346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.253617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.253914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.254643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:01.254941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.256372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.261623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 319/643] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:01.262560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.283833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 325/644] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:01.285135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.368717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d99bd6-74a5-4763-9b1d-b1cfcb18eaa2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.401214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80056-3b44-4a63-b6ab-3da60623cd3e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.409587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.410668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.410937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.411197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] PATH_INFO: `/v3/users/glance` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.419868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.421624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.424209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:01.433437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:01.434485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:01.435566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 320/645] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:01.436171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.445234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.445876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.446151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.446415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.460878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.523564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.524921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.540957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dc42d-f739-410b-871d-aef9538a4dae None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.574720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.575318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.575590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.575852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.639427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 326/646] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:23:01.641121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.648058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.649553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.666990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.678068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.755631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 321/647] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:23:01.756479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.757996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4a84b-b80e-4283-b671-6d99ea37f2fe None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.792712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.793338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.793606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.793897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.803610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:01.808315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:01.809254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:01.810134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 327/648] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:01.810819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.855680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f090f3-531c-4f16-ba23-d37257059317 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.878550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.888313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:01.889328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.889684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.889982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.890335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.891072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:01.891381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.892819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.907709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbd978-b1ba-4040-92b2-c0bfc78fa162 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:01.909303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 322/649] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:01.910121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:01.942276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1426a-5ba6-49bd-b684-acbdc5ce6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:01.942915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1426a-5ba6-49bd-b684-acbdc5ce6413 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.943189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1426a-5ba6-49bd-b684-acbdc5ce6413 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.943456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1426a-5ba6-49bd-b684-acbdc5ce6413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.953210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1426a-5ba6-49bd-b684-acbdc5ce6413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:01.954727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1426a-5ba6-49bd-b684-acbdc5ce6413 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-6cf1426a-5ba6-49bd-b684-acbdc5ce6413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:01.968755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:01.969701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:01.970628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:01.970628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:01.970628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:01.970628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 328/650] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:01.973048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aff3c-4732-4599-bcb5-a04b25625632 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:01.973320 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aff3c-4732-4599-bcb5-a04b25625632 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:01.973585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aff3c-4732-4599-bcb5-a04b25625632 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:01.974853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 329/651] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:01.975532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aff3c-4732-4599-bcb5-a04b25625632 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.014353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ddfe-b779-439f-b2b8-f6bf2fa5453e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.049421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.050004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.050278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.050540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.060951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.062610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.074987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aff3c-4732-4599-bcb5-a04b25625632 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:02.077507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:02.078518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:02.079429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:02.079429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:02.079429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:02.079429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 323/652] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:02.079429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.105150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.110517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.111121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.111395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.111663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.112310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:02.112609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.114014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.114795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.122679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 330/653] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:23:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:02.123459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.184897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f64cc-7232-47d2-bcaa-de9c404f35d4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.219016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.219613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.219885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.220148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.221239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587b6d1-81df-48ef-b197-1ea12616161f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.256778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71107db-e00f-4993-90f2-bff6a9bd31e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.257379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71107db-e00f-4993-90f2-bff6a9bd31e8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.257649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71107db-e00f-4993-90f2-bff6a9bd31e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.257940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71107db-e00f-4993-90f2-bff6a9bd31e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.258570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71107db-e00f-4993-90f2-bff6a9bd31e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:02.258856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71107db-e00f-4993-90f2-bff6a9bd31e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.260207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71107db-e00f-4993-90f2-bff6a9bd31e8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.271320 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 331/654] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:02.272465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7878-6c20-4ce7-bc15-66b2cf82e908 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.272748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7878-6c20-4ce7-bc15-66b2cf82e908 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.273014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e7878-6c20-4ce7-bc15-66b2cf82e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.289444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.290925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.291226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-779e7878-6c20-4ce7-bc15-66b2cf82e908 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:02.292395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-779e7878-6c20-4ce7-bc15-66b2cf82e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:02.323339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.342272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.359791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 332/655] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:23:02.360600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7878-6c20-4ce7-bc15-66b2cf82e908 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.401144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 324/656] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:23:02.401877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.470395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e7878-6c20-4ce7-bc15-66b2cf82e908 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.502799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b271-d417-4c29-a8dd-bb90851ff14c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.507101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.507877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.508289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.508715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.509480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:02.509956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.511513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.529042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 333/657] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:02.529917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.536999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.537629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.537929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.538564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.540570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.550005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.551464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:02.565961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:02.567111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:02.568169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:02.568169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:02.568169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:02.571926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 325/658] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:02.572757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.581218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.644144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b53465-d52d-4585-a8f1-696bffacaf9b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.677878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.678437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.678710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.678969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.680339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675be3f2-f466-4bf8-82d1-817c07aaca8b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.685428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.687000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:02.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:02.699873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 334/659] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:02.701004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.715578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.716227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.716495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.716746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.727354 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.728925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:02.743350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:02.744290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:02.745183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:02.745183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:02.745183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:02.745183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 326/660] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:02.745499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.783451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.804009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dddeb-7695-4308-b69b-b874c279408c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.806847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.840071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.840612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.840879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.841145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.843910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbdf2a-acba-4002-b665-c56f38c88c6d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.847772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.849272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:02.860730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:02.861719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 335/661] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:02.862669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.881397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.882050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.882332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.882625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.883260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:02.883556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:02.884932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:02.897707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 327/662] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:02.898625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:02.961942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1101-a21c-4a38-ad5e-280784684cde None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:02.994351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:02.995600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:02.996236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:02.996505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:02.996766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:02.998127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4ab6a-dffe-4a63-b283-1113fe824381 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.006841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:03.011998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:03.012965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:03.013823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 336/663] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:03.014544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.036474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.037083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.037384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.037654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.038739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.038838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:03.039042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.040544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.052212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 328/664] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.053001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.110498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1fe7d-7588-47d4-a453-9be6aa074b5d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.143338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.143945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.144215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.144554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.145095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.145416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.146811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.152646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755903e-de07-4110-b3da-cb127d551ae9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.159866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 337/665] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.160675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.191149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.191736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.192007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.192273 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.192956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.193259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.194766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.206514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 329/666] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.207317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.230399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:03.243247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:03.261036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ce4d-431b-4c92-80d6-da4f2f2af64a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.295037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.295644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.296128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.296405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.303213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.304629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.313480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eb017-250b-4899-a741-bf0bb19e1c8f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:03.315724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:03.316771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 338/667] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:03.317716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.347369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.347981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.348255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.348526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.349183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.349482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.350924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.359258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 330/668] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.360015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.416524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e7b90-37da-47b1-a5fa-bada00402514 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.443209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:03.448834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.449441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.449713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.450004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.450726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=b7c18108a06141b5b501241b919663bb) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.451016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.452661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.458740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 339/669] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/role_assignments?user.id=b7c18108a06141b5b501241b919663bb&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.459522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.462558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b6ee3-cfd4-4e13-8b09-c5fe7b4ff700 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.481729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:03.501709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.502507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.502945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.503175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.511720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.512730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:03.525361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:03.526595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:03.527704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:03.528202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 331/670] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:03.529057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.594419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a97d91-5678-464e-a697-bea80a4f3b11 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.642859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f53e-d99b-44f3-8acf-abd61635eb68 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.644193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.644874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.645201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.645529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.646362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=e45d799ba78f4adc82f3ffdc9293ff20) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.646710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.648159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 340/671] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/role_assignments?user.id=e45d799ba78f4adc82f3ffdc9293ff20&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.658476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.684091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.685557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.686347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.687310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.688805 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.689673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.691944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.709406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:03.723682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 332/672] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.726066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.756493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:03.795402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f7568-ca8a-47fd-bb19-b76e1e2cd230 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.837661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.838489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.838872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.839227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.852908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.854657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.856657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716793-04a1-4c7d-9e0c-1a4845dddb1b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:03.872086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:03.873284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:03.874484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:03.874484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:03.874484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:03.875878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 341/673] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:03.876355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.901654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:03.902310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:03.902582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:03.902846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:03.903535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:03.903836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:03.905311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:03.919701 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 333/674] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:03.920244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:03.987154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:04.024094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b707-1dfd-4a72-b779-f021d4aa2db1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.036179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420683f8-8820-444f-821b-e303ff3c5b32 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.049405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:04.061969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.062754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.063027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.063299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.073773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.074700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.075112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.075515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.076294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:04.076740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.078326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.091191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 334/675] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:04.092355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.135231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.136668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.232693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e17969-411e-437d-b854-56bb5bea9d9a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.249949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 342/676] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:23:04.251148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.262049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:04.281784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.282438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.282711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.282976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.283698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=b77625f61bca4548af4cd5702d2b807a) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:04.284002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.284816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:04.285834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.298114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 335/677] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/role_assignments?user.id=b77625f61bca4548af4cd5702d2b807a&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:04.299136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.425771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669dbaf-fcd3-4ffb-81cd-d3b88c1c2206 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.476142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c3f32-bb60-4397-9ce3-51713fe7013b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.493714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.494752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.495217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.495720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.505987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.508131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:04.527061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:04.528262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:04.529399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:04.532515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 343/678] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:04.538612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.539896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.540546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.540819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.541084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.552105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.553566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:04.574910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:04.575930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:04.576813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:04.576813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:04.576813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:04.582278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 336/679] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:04.582419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.623849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:04.673964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:04.698484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e4451-2ae4-4ce0-b603-05f657386be6 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.701398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f01a4-0cca-447b-a2f5-bf0779d046be None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.741487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.742274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.742702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.743059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.743750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.743914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:04.744329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.744815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.745224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.745639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.746077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.746684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:04.747124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.749681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.761782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 337/680] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:04.766360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.775986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 344/681] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:04.781517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.896364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:04.899822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cb5fa-64c7-4dae-ad4b-9afb035a2f1c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.912446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923de37-2f53-4b02-9cea-dbb5b02f283f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:04.955082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.956319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.956794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.957473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.965312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:04.967017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:04.970493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:04.971188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:04.971522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:04.971853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:04.980377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:04.981321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:04.982243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:04.985241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 338/682] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:04.991562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:04.999723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:05.112003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:05.114713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:05.155527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823daa6-f3af-4946-bbad-ccf292e57f8c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:05.228040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:05.229025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:05.229496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:05.230089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:05.230793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:05.231094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:05.232681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:05.260300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 339/683] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:05.266264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:05.269498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 345/684] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:23:05.274923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:05.303836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:05.339353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:05.441758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cd83-a51e-4043-bb52-bec2896fe713 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:05.448522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111178-4561-49ba-b03a-bfce4868741b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:05.489151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:05.489765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:05.490062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:05.490328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:05.491057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=c89d986ea1b3488a8873b2e0e87b1ce5) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:05.491359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:05.492804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:05.510578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 340/685] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:05 2022] GET /identity/v3/role_assignments?user.id=c89d986ea1b3488a8873b2e0e87b1ce5&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:05.521301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:05.522006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:05.522282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:05.522551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:05.535134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:05.543235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:05.560321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:05.561693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:05.563653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:05.563653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:05.563653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:05.563653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 346/686] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:05.567405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:05.685288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:05.710582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba06d-b5f1-4745-a95c-4e864feb3ac3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:05.747878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:05.748495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:05.748769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:05.749159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:05.750458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:05.750767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:05.752183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:05.766634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 341/687] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:05.772450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:05.906501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:05.916354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe92340-56e9-4318-a7a5-8a1d74eaa1ea None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:05.953015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5aae2-3f89-48a7-9e6e-07c89f9f0bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:05.953649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5aae2-3f89-48a7-9e6e-07c89f9f0bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:05.953957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5aae2-3f89-48a7-9e6e-07c89f9f0bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:05.954225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5aae2-3f89-48a7-9e6e-07c89f9f0bf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:05.961235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5aae2-3f89-48a7-9e6e-07c89f9f0bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:05.962635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5aae2-3f89-48a7-9e6e-07c89f9f0bf0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-16a5aae2-3f89-48a7-9e6e-07c89f9f0bf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:05.974019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:05.974928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:05.975815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 347/688] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:05.982601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:06.030009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fc55f-b049-424c-95ee-7a888b10ff6c None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.030631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fc55f-b049-424c-95ee-7a888b10ff6c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.031101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fc55f-b049-424c-95ee-7a888b10ff6c None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.032888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 348/689] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:06.039325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364933a3-d4ab-41c7-9f73-8e8d180fbc67 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.039804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364933a3-d4ab-41c7-9f73-8e8d180fbc67 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.040290 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364933a3-d4ab-41c7-9f73-8e8d180fbc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.061279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-364933a3-d4ab-41c7-9f73-8e8d180fbc67 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:06.062957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-364933a3-d4ab-41c7-9f73-8e8d180fbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:06.109076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de629-d5b4-4b30-b70b-68a14cf549ee None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:06.148493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:06.149574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.150132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.150624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.151568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:06.152208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:06.153937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:06.162424 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:06.169117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 342/690] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:06.185332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:06.210099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 349/691] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:23:06.264559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997e6-f38f-4c24-adc3-6b9534966028 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.264857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997e6-f38f-4c24-adc3-6b9534966028 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.265176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997e6-f38f-4c24-adc3-6b9534966028 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.266844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 350/692] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:06.271868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041bc3-c747-439a-a82e-ff265b036f26 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.272146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041bc3-c747-439a-a82e-ff265b036f26 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.272419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041bc3-c747-439a-a82e-ff265b036f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.291677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d1041bc3-c747-439a-a82e-ff265b036f26 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:06.292875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d1041bc3-c747-439a-a82e-ff265b036f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:06.317625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69eb1e-f6fa-4726-b5aa-d7ddd0815c81 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:06.384713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:06.385326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.385600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.385893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.386618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=861b64b65d2642afbacfa20851257333) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:06.386925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:06.393415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:06.407041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 343/693] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:06 2022] GET /identity/v3/role_assignments?user.id=861b64b65d2642afbacfa20851257333&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:06.409518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 351/694] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:23:06.509848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:06.586512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:06.645709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfda55-2b2f-4946-958f-0c86a3a3ff3e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:06.698258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:06.698901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.699177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.699450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.700033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:06.701434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:06.714328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:06.715444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:06.716889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 344/695] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 30 09:23:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:06.721532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1041bc3-c747-439a-a82e-ff265b036f26 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:06.722554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:06.739245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:06.833653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1041bc3-c747-439a-a82e-ff265b036f26 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:06.870644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:06.871625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.872101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.872575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.873223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45de0d-7f86-43b6-8fe2-fd9e8658a2fb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:06.873637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:06.874206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:06.875784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:06.881154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 352/696] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 30 09:23:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:06.887520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:06.914423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:06.915200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:06.915419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:06.915687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:06.922692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:06.934495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:06.938183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:06.939160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:06.940636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 345/697] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:06.945039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:06.994530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:07.022128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff287a-b31d-4e4e-ae18-bab64504efb1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:07.068143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:07.068931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.069300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.069663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.070450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:07.070848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:07.071347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45bb75-a44a-4eb4-a6a6-5042eae5f51d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:07.072401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:07.080094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 353/698] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 30 09:23:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:07.111334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ce39-f50c-4560-831c-4ae92ee3cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:07.112250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ce39-f50c-4560-831c-4ae92ee3cff0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.112672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ce39-f50c-4560-831c-4ae92ee3cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.113097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ce39-f50c-4560-831c-4ae92ee3cff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.113976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ce39-f50c-4560-831c-4ae92ee3cff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:07.114463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ce39-f50c-4560-831c-4ae92ee3cff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:07.116040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ce39-f50c-4560-831c-4ae92ee3cff0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:07.126571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 346/699] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:07.133917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:07.283230 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaca47-139f-44fc-ac60-061b6c050fd4 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:07.303237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d8e9-75e3-4a46-b6a0-60ddbf0c89fd None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d8e9-75e3-4a46-b6a0-60ddbf0c89fd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.303766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478d8e9-75e3-4a46-b6a0-60ddbf0c89fd None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.305854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 347/700] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:07.310885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb186-e35f-4927-9e20-c94d87401677 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.311290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb186-e35f-4927-9e20-c94d87401677 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.311754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb186-e35f-4927-9e20-c94d87401677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.328807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:07.329457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.329721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.330021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.337991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e57eb186-e35f-4927-9e20-c94d87401677 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:07.339342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e57eb186-e35f-4927-9e20-c94d87401677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:07.344140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:07.345863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:07.348755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:07.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:07.364379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:07.365527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:07.365527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:07.365527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:07.367277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 354/701] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:07.373224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:07.398247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:07.419340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 348/702] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:23:07.484337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008b88-a81b-4daa-aa34-4bc0273ad91e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:07.525341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:07.526241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.526664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.527107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.527888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:07.528332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:07.529872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:07.551093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 355/703] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:07.556239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57eb186-e35f-4927-9e20-c94d87401677 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:07.710862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57eb186-e35f-4927-9e20-c94d87401677 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:07.767001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:07.767944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.768393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.768807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.781484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:07.783201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:07.803336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:07.804626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:07.805869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:07.808029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 349/704] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:23:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:07.813459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:07.865020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:07.883655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:07.939408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:07.950600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407a9fa-5a1e-4108-bc86-8d110ce7c2e9 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:07.987546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:07.988395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:07.988816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:07.989245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:07.990159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:07.990610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:07.992184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.010661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 356/705] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:23:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:08.016917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:08.079453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a335b-eb9f-4a8f-8298-f9841d53d0c8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:08.148112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47519-e58b-41c2-a144-6189c0e45620 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:08.164228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:08.164812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.165085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.165349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.170261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:08.184663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:08.185546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.186021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.186542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.191219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:08.192377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:08.229987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:08.231164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:08.232259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:08.232259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:08.232259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:08.232259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 350/706] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:08.238442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:08.270671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:08.272546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.397549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 357/707] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:23:08.405419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:08.422131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:08.503580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:08.509652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98465e0f-04a8-4a98-9658-d39dc10d37ee None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:08.510781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6fee3-4b2b-415e-99a2-79b703280532 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:08.546258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:08.546896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.547173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.547439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.555705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8ddf-1a3e-4a05-9467-180c106a98f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:08.556308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8ddf-1a3e-4a05-9467-180c106a98f8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.556605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8ddf-1a3e-4a05-9467-180c106a98f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.557315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8ddf-1a3e-4a05-9467-180c106a98f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.558241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8ddf-1a3e-4a05-9467-180c106a98f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:08.558549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8ddf-1a3e-4a05-9467-180c106a98f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:08.558930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:08.559924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8ddf-1a3e-4a05-9467-180c106a98f8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.560502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.574061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 351/708] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:08.575419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c292-a2a9-4ebf-8b4d-07aacb439546 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.575694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c292-a2a9-4ebf-8b4d-07aacb439546 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.575957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c292-a2a9-4ebf-8b4d-07aacb439546 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:08.576396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:08.577520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:08.578681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:08.578681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:08.578681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:08.578915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 352/709] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:08.578997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 358/710] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:08.583277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9d901-139c-4a50-836a-dc3d572b0bae None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.583394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:08.583555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9d901-139c-4a50-836a-dc3d572b0bae None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.583821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9d901-139c-4a50-836a-dc3d572b0bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.603122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6cd9d901-139c-4a50-836a-dc3d572b0bae None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:08.604301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6cd9d901-139c-4a50-836a-dc3d572b0bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:08.655795 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:08.686152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 353/711] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:23:08.687405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9d901-139c-4a50-836a-dc3d572b0bae None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:08.698471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41994e1d-7a09-49a9-b270-ae55924c5f41 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:08.741034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:08.741637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.742118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.742382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.743018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:08.743302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:08.749865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.771763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 359/712] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:08.778564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:08.843909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:08.891934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9d901-139c-4a50-836a-dc3d572b0bae None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:08.921909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e1d6-fc9e-4e54-bc7f-557061b6ff71 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:08.946890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:08.959773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:08.960414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.960744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.961018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.969426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:08.971490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.977310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:08.978035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:08.978377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:08.978715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:08.979422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:08.980958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:08.983726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:08.984600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:08.985575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 360/713] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:08.990792 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:09.013195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 354/714] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:23:08 2022] POST /identity/v3/users => generated 254 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:09.014289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:09.209836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0101-5b57-4126-aad7-ee2091b2f2a5 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:09.233419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651e9c-ec47-4a86-bb81-48a09a73a3e1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:09.251987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:09.253091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.253370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.253639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.254655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:09.254964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:09.256685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:09.270990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 361/715] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:09.277157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:09.280378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:09.282014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.282293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.282558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] PATH_INFO: `/v3/services/network` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.283154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:09.284548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:09.287999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:09.298791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:09.299824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:09.300689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:09.301476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 355/716] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:09 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:09.306813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:09.343024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:09.427690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08375a8a-317e-4f08-a837-aa7786349b5a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:09.448347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da02f25-0572-4eff-8410-506524c4bd82 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:09.470550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:09.472107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.472851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.473335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.474381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=e45d799ba78f4adc82f3ffdc9293ff20) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:09.474931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:09.476615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:09.484323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 362/717] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:09 2022] GET /identity/v3/role_assignments?user.id=e45d799ba78f4adc82f3ffdc9293ff20&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:09.485728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564096-35c3-4d35-b137-decee65289de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:09.486381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564096-35c3-4d35-b137-decee65289de None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.486652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564096-35c3-4d35-b137-decee65289de None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.486918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564096-35c3-4d35-b137-decee65289de None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.487551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a564096-35c3-4d35-b137-decee65289de None admin] RBAC: Adding query filter params (name=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:09.487848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a564096-35c3-4d35-b137-decee65289de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:09.489256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a564096-35c3-4d35-b137-decee65289de None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:09.495624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 356/718] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:09.501451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:09.510224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b307-5141-499d-92a3-2df9ab87ea63 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.510501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b307-5141-499d-92a3-2df9ab87ea63 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.510765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b307-5141-499d-92a3-2df9ab87ea63 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.512661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 357/719] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:09.519050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e22f-e5c1-4dc9-a416-fe39d6f64c06 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.519705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e22f-e5c1-4dc9-a416-fe39d6f64c06 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.520037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e22f-e5c1-4dc9-a416-fe39d6f64c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.542194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-44d1e22f-e5c1-4dc9-a416-fe39d6f64c06 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:09.543869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-44d1e22f-e5c1-4dc9-a416-fe39d6f64c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:09.677969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:09.697713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 358/720] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:23:09.710667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba079d60-e695-4888-9fdb-591e82d5d9ce None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:09.712373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac777ff-b274-476f-abb8-766a6b6ba228 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.712657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac777ff-b274-476f-abb8-766a6b6ba228 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.712925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac777ff-b274-476f-abb8-766a6b6ba228 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.714350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 359/721] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:09.722181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f661-f6f2-4780-b539-38e1e3e76ed4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.722442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f661-f6f2-4780-b539-38e1e3e76ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.722647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f661-f6f2-4780-b539-38e1e3e76ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.738575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:09.751780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a817f661-f6f2-4780-b539-38e1e3e76ed4 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:09.754155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a817f661-f6f2-4780-b539-38e1e3e76ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:09.795888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:09.796555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:09.796830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:09.797093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:09.797718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] RBAC: Adding query filter params (type=network) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:09.799108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:09.800927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:09.810698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 363/722] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:09.846853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 360/723] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:23:10.059925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:10.178150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51936a7c-5667-45d0-80fb-b5f01061371b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:10.201254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817f661-f6f2-4780-b539-38e1e3e76ed4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:10.218246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:10.218678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:10.218951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:10.219219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:10.229745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:10.235115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:10.236093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:10.236970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 364/724] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:10.244013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:10.316467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:10.408281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817f661-f6f2-4780-b539-38e1e3e76ed4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:10.451280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421c989-0ebf-4d46-99ab-1b13425f2f28 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:10.458006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:10.482422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:10.483453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:10.483905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:10.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:10.485314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:10.487145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:10.495939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:10.495939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:10.495939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:10.495939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:10.496428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:10.496428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:10.496428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:10.508620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 365/725] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:10.515315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:10.526067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 361/726] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:10 2022] POST /identity/v3/services => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:10.642808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:10.649831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c261454-9d66-43d4-9012-f27b7e0f67fc None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:10.710582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:10.711223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:10.711505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:10.711763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:10.723590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:10.725074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:10.742414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:10.743493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:10.744403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:10.744403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:10.744403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:10.744403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 366/727] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:10.749769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:10.860706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb7332-18df-493e-8087-db7338810e37 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:10.903899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:10.904428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:10.904699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:10.905016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:10.905672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:10.906104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:10.907526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:10.922086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 362/728] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:10.931189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:11.052664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3328a3-d802-4016-8bce-d7924299e85e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:11.103076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:11.103836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:11.104081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:11.105000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:11.118773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:11.120334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:11.134233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:11.135226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:11.136212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 367/729] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:11.141401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:11.201898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:11.268452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba97f2-ccc2-45a1-b59b-3f87d1dd5f86 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:11.304916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:11.305582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:11.305886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:11.306159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:11.306888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:11.307192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:11.308630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:11.333421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 363/730] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 30 09:23:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:11.339191 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:11.348416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:11.482481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e831d-8e0d-4e7e-8aef-68a6ad330538 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:11.527385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a938c-4c5e-4b84-89a2-c460722eb935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:11.528011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a938c-4c5e-4b84-89a2-c460722eb935 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:11.528287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a938c-4c5e-4b84-89a2-c460722eb935 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:11.528551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a938c-4c5e-4b84-89a2-c460722eb935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:11.613852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a938c-4c5e-4b84-89a2-c460722eb935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:11.613852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a938c-4c5e-4b84-89a2-c460722eb935 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:11.615490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:11.740092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 368/731] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:11 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:23:11.754949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:11.795030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cb33e-f5ef-4f7d-b67b-3ab82ca82071 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:11.795366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cb33e-f5ef-4f7d-b67b-3ab82ca82071 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:11.795596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cb33e-f5ef-4f7d-b67b-3ab82ca82071 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:11.797164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 369/732] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:11.802206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0b75c-7d4f-4110-a3c6-6d94c172d905 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:11.802480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0b75c-7d4f-4110-a3c6-6d94c172d905 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:11.802747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0b75c-7d4f-4110-a3c6-6d94c172d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:11.832498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c4e0b75c-7d4f-4110-a3c6-6d94c172d905 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:11.833692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c4e0b75c-7d4f-4110-a3c6-6d94c172d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:11.941112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 370/733] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:23:11.959759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33d5b-09a1-4297-821d-0121b9e3ec70 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:11.961483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:12.011259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:12.011798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.012072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.012346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.023246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:12.024711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:12.033491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac600f-b55e-4343-b865-8521f6255b92 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.033816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac600f-b55e-4343-b865-8521f6255b92 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.034063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac600f-b55e-4343-b865-8521f6255b92 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.035620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 371/734] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:12.041208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:12.042184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:12.043099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:12.043099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:12.043099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:12.044794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 364/735] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:12.048974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478298fe-edef-49a1-9769-4a50df0fa3f9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.048974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478298fe-edef-49a1-9769-4a50df0fa3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.048974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478298fe-edef-49a1-9769-4a50df0fa3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.050854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.078686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-478298fe-edef-49a1-9769-4a50df0fa3f9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:12.080924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-478298fe-edef-49a1-9769-4a50df0fa3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:12.131707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:12.210416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 372/736] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:23:12.221236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cab94-f1c1-4583-b073-4f33cbd1a8dd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:12.255924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:12.256819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.257240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.257653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.258480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:12.258926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:12.260483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:12.273574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 365/737] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:12.279359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478298fe-edef-49a1-9769-4a50df0fa3f9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.284225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.307870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:12.448230 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478298fe-edef-49a1-9769-4a50df0fa3f9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:12.472008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7b37f-ab12-4faf-a72c-29cc2f5317b8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:12.507341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed59d3f-52da-4f5c-be5e-909e4faeac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:12.508146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59d3f-52da-4f5c-be5e-909e4faeac03 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.508512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59d3f-52da-4f5c-be5e-909e4faeac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.508874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59d3f-52da-4f5c-be5e-909e4faeac03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.515990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed59d3f-52da-4f5c-be5e-909e4faeac03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:12.517631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed59d3f-52da-4f5c-be5e-909e4faeac03 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:12.525732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9de83c-a8a1-423c-9d6b-3c9180aa136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:12.526734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9de83c-a8a1-423c-9d6b-3c9180aa136c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.527148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9de83c-a8a1-423c-9d6b-3c9180aa136c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.527592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9de83c-a8a1-423c-9d6b-3c9180aa136c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-7ed59d3f-52da-4f5c-be5e-909e4faeac03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:12.529979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:12.530981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:12.531885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:12.532330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 373/738] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:12.533866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262625c2-c283-4e5b-a4f6-153f959409f3 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.533866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262625c2-c283-4e5b-a4f6-153f959409f3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.534180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262625c2-c283-4e5b-a4f6-153f959409f3 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.535460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 374/739] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:12.539031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262625c2-c283-4e5b-a4f6-153f959409f3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.545752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9de83c-a8a1-423c-9d6b-3c9180aa136c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4a9de83c-a8a1-423c-9d6b-3c9180aa136c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:12.551148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:12.552063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:12.552922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:12.555446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 366/740] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:12.561553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedee13-771c-4dbc-b151-d5600204cf73 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.562195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedee13-771c-4dbc-b151-d5600204cf73 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.562669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedee13-771c-4dbc-b151-d5600204cf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.566062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:12.581410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2aedee13-771c-4dbc-b151-d5600204cf73 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:12.582625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2aedee13-771c-4dbc-b151-d5600204cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:12.653876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 367/741] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:23:12.655008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedee13-771c-4dbc-b151-d5600204cf73 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.663601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:12.664434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262625c2-c283-4e5b-a4f6-153f959409f3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:12.702078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:12.702719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.702991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.703259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.703944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:12.704247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:12.705670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:12.718805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 375/742] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:12.719742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.799175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedee13-771c-4dbc-b151-d5600204cf73 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:12.813035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:12.834118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9424-5941-436a-97d8-5a1c89ab8909 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:12.845393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:12.846772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.847526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.847991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.849124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:12.850099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:12.852229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:12.865448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 368/743] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:12.867006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.870500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:12.871189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:12.871467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:12.871750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:12.887994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:12.894102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:12.895048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:12.895939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:12.903479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 376/744] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:12.903479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:12.957909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:12.995218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a590-9b00-493f-ab95-815eb79395a5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.012693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a8e4b-487e-4d15-be05-e9e23221a00b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.030960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.031561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.031831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.032092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.033219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=861b64b65d2642afbacfa20851257333) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:13.033520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.035418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.042135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 369/745] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/role_assignments?user.id=861b64b65d2642afbacfa20851257333&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:13.042930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.055590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.056807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.057288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.057814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.073031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.075134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.078001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:13.094931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:13.095965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:13.096891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:13.096891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:13.096891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:13.103736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 377/746] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:13.103736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.181228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c78586-66e1-4807-ad15-0a49c5cf44b1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.213991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:13.223201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.223882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.224156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.224426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.225820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:13.226116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.227517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.236968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e3bd-dd5a-4572-9682-e849a54503b3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.237707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 370/747] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:13.238771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.283038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.283717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.284405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.284691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.285608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.287268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.314138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 378/748] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:13 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:13.315057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.384831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0e4e-4dcb-4441-b057-77f027bc406b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.438524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:13.477639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c16138-21f6-40be-bb44-fb6c7fed33a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.478713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16138-21f6-40be-bb44-fb6c7fed33a2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.479185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16138-21f6-40be-bb44-fb6c7fed33a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.479692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16138-21f6-40be-bb44-fb6c7fed33a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.480557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c16138-21f6-40be-bb44-fb6c7fed33a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:13.481113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c16138-21f6-40be-bb44-fb6c7fed33a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.482815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c16138-21f6-40be-bb44-fb6c7fed33a2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.507492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 371/749] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:13.509280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d392f15-56a0-49a6-9569-f1630107106b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.509740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d392f15-56a0-49a6-9569-f1630107106b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.510254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d392f15-56a0-49a6-9569-f1630107106b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.511974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 372/750] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:13.512873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d392f15-56a0-49a6-9569-f1630107106b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.522595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc436b-edbf-42fe-bd85-1ab27dfbdc0d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.566723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b91d09-f5d2-4f16-a484-934982cfbdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.567260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91d09-f5d2-4f16-a484-934982cfbdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.567534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91d09-f5d2-4f16-a484-934982cfbdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.567797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91d09-f5d2-4f16-a484-934982cfbdc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.573432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:13.580202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b91d09-f5d2-4f16-a484-934982cfbdc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.582550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b91d09-f5d2-4f16-a484-934982cfbdc6 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-08b91d09-f5d2-4f16-a484-934982cfbdc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:13.600728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:13.601821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:13.602772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:13.602772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:13.602772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:13.607032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 379/751] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:13.607032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420582c-7a59-43f1-93c0-d2ffca451551 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.607032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420582c-7a59-43f1-93c0-d2ffca451551 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.607032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420582c-7a59-43f1-93c0-d2ffca451551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.635411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f420582c-7a59-43f1-93c0-d2ffca451551 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:13.636933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f420582c-7a59-43f1-93c0-d2ffca451551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:13.646145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d392f15-56a0-49a6-9569-f1630107106b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.687486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.688551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.688896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.689251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.697815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.700117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.712151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 380/752] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:13.713328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420582c-7a59-43f1-93c0-d2ffca451551 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:13.715018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:13.715950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:13.717215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 373/753] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:13.722672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.751121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:13.819043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420582c-7a59-43f1-93c0-d2ffca451551 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.845577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880a10-2a2f-4e2c-82d9-9a3d328945e6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:13.882476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.883457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.884474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.884937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.885881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:13.886380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.888018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.899202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:13.908896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 374/754] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:13.914326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:13.934936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:13.935559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:13.935828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:13.936141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:13.936867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:13.937175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:13.939474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:13.960530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 381/755] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:13.966821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.082419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7919fc6-95b6-431d-b4ad-ff5055d2a6aa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.111482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.120105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e312214-acc3-43a3-800d-5a185b624c78 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.124049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.124750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.125087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.125436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.157506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.158673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.159115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.159516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.167515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.169363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.171613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:14.184333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:14.185283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:14.186375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:14.188642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 382/756] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:14.189732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.208112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.210200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.307050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc191c-f11f-43e7-8034-56793b5f1e5a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.332358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 375/757] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:23:14.332358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.353064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.354308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.355098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.355578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.356575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.358370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:14.370626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:14.371696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:14.372562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:14.379904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 383/758] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:14.379904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.408339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.411180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.458745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e905e-6a6e-46c7-a4da-f85152b69c35 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.492253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f866b-0cb1-476b-8f1b-9fb2c44d4380 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.500536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.501887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.502385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.502841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.504101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:14.504895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.506894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.529072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 376/759] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:14.529728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.541824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.541824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.541824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.541824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.554613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.556338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:14.573932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:14.574940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:14.575834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:14.575834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:14.575834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:14.575834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 384/760] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:14.576757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.655559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d1a41-e884-48f3-bb2a-5e52ed5c18ef None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.664225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.680421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.692776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.693875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.694294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.694697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.695487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:14.695921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.696883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed38d0-0fbe-4591-aa81-75eed38a4035 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.697598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.702774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 377/761] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:14.703858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.731843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.732474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.733232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.733232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.744165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.745725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:14.760106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:14.761256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:14.762368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:14.762368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:14.762368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:14.765970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 385/762] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:14.766823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.811907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c63e1-019e-4b84-9787-73fff31c3dfe None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.846793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.848111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.848537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.848935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.849697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:14.850156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.851658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.863953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 378/763] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:14.865051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.867634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da50d6-e4a4-408e-b966-3a82e499d099 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:14.891421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.903639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:14.904248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:14.904521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:14.904826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:14.905458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:14.905756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:14.907151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:14.912475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 386/764] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:14.913694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:14.918046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:14.972732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c13d4-73cb-4566-9f61-8d4e29428dd0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.008591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.009477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.009917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.010320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.011086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:15.011519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.013046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.016360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226de89-c7e3-4dce-852a-20da8741ab8f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.030289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 379/765] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:15.031611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:15.052657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.053296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.053569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.053895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.061203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.063502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:15.075159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:15.076252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 387/766] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:15.077564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:15.141557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:15.158770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d57af-f8e8-4cd4-9600-771f4e57d4e5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.171679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:15.205013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885f049-4d0f-4f25-aab4-36164a4a8287 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.210773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.211470 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.211808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.212143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.212909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] RBAC: Adding query filter params (interface=public, service_id=6c7ab28d23264b53953b0a5347ee2140, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:15.213279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.215343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.226304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 380/767] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:23:15 2022] GET /identity/v3/endpoints?service_id=6c7ab28d23264b53953b0a5347ee2140&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:15.227203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:15.247315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.248360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.248868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.249344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.259017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.260817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:15.275355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:15.276325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:15.277263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:15.280141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 388/768] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:15.281269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:15.375648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3efcc2-0f87-47df-b22f-f8904857653c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.398069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeda060-a8f3-4cd5-b3d9-f77e264ed3a3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.408715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:15.421455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.422095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.422372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.422636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.423865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:15.424172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.425966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.438750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70511d-33bd-44b3-a54a-4affe47c779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.439663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70511d-33bd-44b3-a54a-4affe47c779d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.440145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70511d-33bd-44b3-a54a-4affe47c779d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.440596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70511d-33bd-44b3-a54a-4affe47c779d None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.440886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 381/769] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:15.441616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70511d-33bd-44b3-a54a-4affe47c779d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.441731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:15.443517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70511d-33bd-44b3-a54a-4affe47c779d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.449638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 389/770] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:15 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:15.451397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced333-175d-43c1-9a3f-c4cb536a22d7 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.452003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced333-175d-43c1-9a3f-c4cb536a22d7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.452480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced333-175d-43c1-9a3f-c4cb536a22d7 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.454446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 390/771] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:15.455492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced333-175d-43c1-9a3f-c4cb536a22d7 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:15.483274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:15.586996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01df73-52e8-4374-b406-4cf4fcb5d023 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.595543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced333-175d-43c1-9a3f-c4cb536a22d7 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.641858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1397ca-2d0f-47f9-bed9-c0f6b6a9c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.642862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1397ca-2d0f-47f9-bed9-c0f6b6a9c740 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.643361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1397ca-2d0f-47f9-bed9-c0f6b6a9c740 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.643783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1397ca-2d0f-47f9-bed9-c0f6b6a9c740 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.644487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1397ca-2d0f-47f9-bed9-c0f6b6a9c740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:15.645654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1397ca-2d0f-47f9-bed9-c0f6b6a9c740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.647043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1397ca-2d0f-47f9-bed9-c0f6b6a9c740 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.648899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cb8e8-b555-4df8-b001-04bfdcc0ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.649486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cb8e8-b555-4df8-b001-04bfdcc0ac65 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.649756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cb8e8-b555-4df8-b001-04bfdcc0ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.650085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cb8e8-b555-4df8-b001-04bfdcc0ac65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.650806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cb8e8-b555-4df8-b001-04bfdcc0ac65 None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=20cb8cab884f4c1ab8a365b944df70e9) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:15.651092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cb8e8-b555-4df8-b001-04bfdcc0ac65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.652500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cb8e8-b555-4df8-b001-04bfdcc0ac65 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.658644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 391/772] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:15 2022] GET /identity/v3/role_assignments?user.id=20cb8cab884f4c1ab8a365b944df70e9&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:15.658986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 382/773] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:15.659846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7da77-6e66-4eef-912a-a16371b58900 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.660125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7da77-6e66-4eef-912a-a16371b58900 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.660394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7da77-6e66-4eef-912a-a16371b58900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.661189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b89a7-9132-4fa6-90a6-6ce02ba6bae8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.661451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b89a7-9132-4fa6-90a6-6ce02ba6bae8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.661723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b89a7-9132-4fa6-90a6-6ce02ba6bae8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.663517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 383/774] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:15.668479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b89a7-9132-4fa6-90a6-6ce02ba6bae8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:15.684352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2aa7da77-6e66-4eef-912a-a16371b58900 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:15.685598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2aa7da77-6e66-4eef-912a-a16371b58900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:15.721266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:15.773397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 392/775] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:15.774925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f77d-8271-4db0-99a0-915b6bc32f64 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.775220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f77d-8271-4db0-99a0-915b6bc32f64 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.775539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f77d-8271-4db0-99a0-915b6bc32f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.807402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:15.817272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ed44f77d-8271-4db0-99a0-915b6bc32f64 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:15.820727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ed44f77d-8271-4db0-99a0-915b6bc32f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:15.837831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b89a7-9132-4fa6-90a6-6ce02ba6bae8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:15.911847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:15.912481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:15.912734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:15.913373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/e45d799ba78f4adc82f3ffdc9293ff20/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:15.920258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=e45d799ba78f4adc82f3ffdc9293ff20, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:15.921992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 393/776] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:15.922567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:15.956598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 384/777] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:23:15 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/e45d799ba78f4adc82f3ffdc9293ff20/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:23:16.059252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44f77d-8271-4db0-99a0-915b6bc32f64 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:16.196903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:16.203007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44f77d-8271-4db0-99a0-915b6bc32f64 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:16.239330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:16.252697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:16.253356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:16.253627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:16.253912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:16.278937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:16.284005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:16.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:16.285924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:16.287245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 394/778] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:16.294753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:16.397907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fd8d1-22c0-4c42-a021-b047181c2576 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:16.456306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad9e3d-4cd1-407f-a48f-b302c4ceaf83 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:16.469904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:16.470556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:16.470835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:16.471105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] PATH_INFO: `/v3/services/network` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:16.471696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:16.473079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:16.489116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:16.490287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:16.491151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 385/779] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:16 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:16.500921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:16.522067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:16.522700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:16.522977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:16.523243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:16.523928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:16.524227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:16.525620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:16.540318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:16.541978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 395/780] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:16.548791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:16.578279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:16.672236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b94f4-964c-4697-a502-a546e634e56a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:16.710982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:16.712165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:16.712671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:16.713141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:16.727928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:16.729764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:16.746558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:16.747572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:16.748541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:16.748541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:16.748541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:16.751396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 396/781] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:16.762699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:16.775385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddd20d-1144-4b88-8c74-75a9950415ce None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:16.830553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:16.831188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:16.831465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:16.831734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:16.832377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] RBAC: Adding query filter params (name=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:16.832688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:16.834093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:16.844185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 386/782] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:16.863015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:16.874586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:16.912176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74b90-7366-4db0-a1c5-fba3475e7865 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:16.981932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:16.983046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:16.984394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:16.985078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:16.987305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:16.987881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:16.990837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:17.019822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 397/783] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:17.026168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:17.026318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:17.072978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394fee-c746-4d69-9aaf-773ccf4d0e7d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:17.128522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:17.129529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:17.130060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:17.130535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:17.131364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] RBAC: Adding query filter params (type=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:17.132036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:17.134010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:17.145937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 387/784] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:17.148244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:17.229565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbac22-3703-4cf5-b1f8-0fa575045d48 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:17.287634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:17.297593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:17.298264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:17.298532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:17.298793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:17.315913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:17.317359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:17.340038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:17.346701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:17.348951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:17.350635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 398/785] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:17.351703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:17.358073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72473d2-87bf-463e-bad9-9cb8df0ffc7b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:17.424794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:17.425890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:17.426629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:17.428122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:17.429032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] RBAC: Adding query filter params (interface=public, service_id=448ba73b141d43a2a4971237c3648a62, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:17.429755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:17.432361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:17.442267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 388/786] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:23:17 2022] GET /identity/v3/endpoints?service_id=448ba73b141d43a2a4971237c3648a62&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:17.448063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:17.464556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:17.546294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948243-3740-411c-8b09-7c4f3a0c5822 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:17.618482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:17.619502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:17.619977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:17.620444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:17.621376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:17.629839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:17.629839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:17.667046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 399/787] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 30 09:23:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:17.672980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:17.764684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:17.854580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6588f-2f4f-46e4-879f-52f17e8b0516 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:17.882222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5f85e-a307-4a19-8285-e5a245b6fb3a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:17.903836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:17.904441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:17.904728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:17.905012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:17.905611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:17.908301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:17.918463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 389/788] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:17 2022] GET /identity/v3/services => generated 772 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:17.931439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:17.932077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:17.932345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:17.932606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:17.944885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:17.946392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:17.966338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:17.967493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:17.968386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:17.968386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:17.968386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:17.968386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 400/789] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:17.974912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:18.082224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:18.110727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc52554-5ffe-4521-9790-4a8f9fd8c184 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:18.147292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de5e67-a787-43de-a6bf-29fb726bbb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:18.147918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5e67-a787-43de-a6bf-29fb726bbb6c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.148190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5e67-a787-43de-a6bf-29fb726bbb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.148450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5e67-a787-43de-a6bf-29fb726bbb6c None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.149121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de5e67-a787-43de-a6bf-29fb726bbb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:18.149396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de5e67-a787-43de-a6bf-29fb726bbb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:18.150869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de5e67-a787-43de-a6bf-29fb726bbb6c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:18.165470 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 390/790] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:18.171674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:18.213644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766edd-d010-4368-80aa-ebb18f7b1e15 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.213965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766edd-d010-4368-80aa-ebb18f7b1e15 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.214220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6766edd-d010-4368-80aa-ebb18f7b1e15 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.215543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 391/791] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:18.220729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4121-01fa-4000-8fb1-51d3b43f37bb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.221009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4121-01fa-4000-8fb1-51d3b43f37bb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.221274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4121-01fa-4000-8fb1-51d3b43f37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.241114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b5fe4121-01fa-4000-8fb1-51d3b43f37bb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:18.242490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b5fe4121-01fa-4000-8fb1-51d3b43f37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:18.292987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:18.298036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fced9ae-bd0c-40d8-8ad1-52164dfa4e1a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:18.321598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 392/792] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:18.329634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31f7c9-abc1-407b-88b4-84611b379687 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.329982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31f7c9-abc1-407b-88b4-84611b379687 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.330271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31f7c9-abc1-407b-88b4-84611b379687 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.332002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 393/793] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:18.334818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:18.335651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.336097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.336550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.337180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac6fa-0d65-4321-a664-619a10c464a0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.337443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac6fa-0d65-4321-a664-619a10c464a0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.337709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac6fa-0d65-4321-a664-619a10c464a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.344886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:18.346700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:18.360604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:18.361608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:18.362557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:18.363003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fc4ac6fa-0d65-4321-a664-619a10c464a0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:18.363003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fc4ac6fa-0d65-4321-a664-619a10c464a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:18.365110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 401/794] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:18.371445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:18.453690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:18.472544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 394/795] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:18.552103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42735c-1f98-4a90-9d1e-e5da7cd8af95 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:18.603494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af644-9368-42ec-af79-8ca0021e9832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:18.604104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af644-9368-42ec-af79-8ca0021e9832 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.604376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af644-9368-42ec-af79-8ca0021e9832 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.604642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af644-9368-42ec-af79-8ca0021e9832 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.605340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225af644-9368-42ec-af79-8ca0021e9832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:18.605634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225af644-9368-42ec-af79-8ca0021e9832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:18.612669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225af644-9368-42ec-af79-8ca0021e9832 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:18.630753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 402/796] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:18.637140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ac6fa-0d65-4321-a664-619a10c464a0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:18.707684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdb11-9e88-4f46-b1f4-0a497b5e8cb6 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.708041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdb11-9e88-4f46-b1f4-0a497b5e8cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.708208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdb11-9e88-4f46-b1f4-0a497b5e8cb6 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.709779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 403/797] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:18.720913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce2bef-1423-4a08-be4d-67f870449ed1 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.721190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce2bef-1423-4a08-be4d-67f870449ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.721449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce2bef-1423-4a08-be4d-67f870449ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.739785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-04ce2bef-1423-4a08-be4d-67f870449ed1 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:18.740887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-04ce2bef-1423-4a08-be4d-67f870449ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:18.756142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:18.786829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ac6fa-0d65-4321-a664-619a10c464a0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:18.811667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 404/798] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:18.812599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce2bef-1423-4a08-be4d-67f870449ed1 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:18.831182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:18.831898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:18.832173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:18.832441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/861b64b65d2642afbacfa20851257333/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:18.834942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=861b64b65d2642afbacfa20851257333, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:18.836903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:18.855433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 395/799] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:23:18 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/861b64b65d2642afbacfa20851257333/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:23:18.856797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:18.937253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce2bef-1423-4a08-be4d-67f870449ed1 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:18.937449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:18.996260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bb418-585c-4729-98a4-90e3d617c1ab None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.042198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.043807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.044088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.044356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.044950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.046817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.048870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.049655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.049952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.050218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.063262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:19.068333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:19.069338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:19.070236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 405/800] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:19.072922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:19.074892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:23:19.076011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:19.079784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.079934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 396/801] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 30 09:23:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:19.082830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.093741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:19.205529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2feacb-4383-481c-8fd6-05da4a1f9ccc None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.229892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22c536-c27f-4c2c-9d00-0800e27d0161 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.246974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.247689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.248034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.248647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.249382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:19.249746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.251316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.254406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:19.261458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 406/802] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:19.262426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.278334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.279452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.280784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.281354 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.282289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:19.283023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.284962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.291410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 397/803] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:19.292827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.341507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:19.382354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de09d1-5bf2-42c2-9ae6-a450eaeba4c7 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.418372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.419153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.419497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.419833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.428392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97819c0c-db6b-4db3-8ed4-dec19c7e54d4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.431742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:19.438484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:19.439426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:19.440276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 407/804] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:19.440960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.474887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.476437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.476885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.477336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.497181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.499729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:19.519974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:19.520965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:19.521911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:19.521911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:19.521911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:19.528077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 398/805] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:19.528077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.561993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f91a6-d3b2-499c-8229-cf90db54116e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.572184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:19.593907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:19.603413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.604354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.604846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.605323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.606246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:19.606829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.608617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.615632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 408/806] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:19.616786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.670575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272db64-49f8-44eb-b19c-fe05e9bf1792 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.716465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.718109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.718549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.718995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.719846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:19.720282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.721815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.735055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c102-6f9e-4d61-8479-d43d59e5aa0f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.735566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 399/807] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:19.736604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.771276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.772074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.772415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.772765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.773519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:19.773920 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.775403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.793124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 409/808] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:19.793124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.853612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:19.858867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:19.866077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b367e3-fdb6-4ee1-920a-d623b6b7e53c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.911180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.911750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e123c-d223-4707-8ac5-13db2a65de54 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:19.911913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.912302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.912630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.913726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.915200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:19.945604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 400/809] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:19.946579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:19.970340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:19.970990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:19.971261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:19.971526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:19.994355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:19.995823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:20.035415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:20.036476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:20.037367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:20.037367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:20.037367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:20.050301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 410/810] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:20.051633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.067269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cc1ff-922a-476b-b7e4-bfd12232c0a4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.109820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.110489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.110761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.111029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.121579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.123972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:20.138134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:20.139204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:20.140135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 401/811] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:23:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:20.146118 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.160946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:20.221967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1085da-dc1c-47ab-aa14-0968003af6eb None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.226742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:20.265456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.266454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.266949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.267463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.268294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:20.268781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.271753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.276172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f5897-9047-489f-90ba-23b242f2d492 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.286098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 411/812] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:20.292819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.320589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.321203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.321485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.321743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.323439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:20.323743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.325856 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.349787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 402/813] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:20.355333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.406222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03750ca0-a7d4-445f-b65f-e814801237e0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.424203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:20.444158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.444849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.445172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.445503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.453729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.455545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.466379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66315d2b-07aa-4be7-9496-37143646e673 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:20.468805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:20.469747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:20.470745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 412/814] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:20.477139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.510120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:20.511287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.512091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.512505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.512937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.524381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.526092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:20.541962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:20.542964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:20.543879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:20.543879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:20.543879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:20.546240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 403/815] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:20.551941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.593841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed4f6-7428-418f-8c71-30dc4404df0d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.630080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1cf23-4167-43b9-bd82-9471ac799e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.630776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cf23-4167-43b9-bd82-9471ac799e4b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.631056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cf23-4167-43b9-bd82-9471ac799e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.631313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cf23-4167-43b9-bd82-9471ac799e4b None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.632034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1cf23-4167-43b9-bd82-9471ac799e4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:20.632328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1cf23-4167-43b9-bd82-9471ac799e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.633751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1cf23-4167-43b9-bd82-9471ac799e4b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.651485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 413/816] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:20.652736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d924c-49bc-4b3d-97e4-3766c99c8d6f None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.653013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d924c-49bc-4b3d-97e4-3766c99c8d6f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.653282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d924c-49bc-4b3d-97e4-3766c99c8d6f None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.659382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 414/817] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:20.660185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d924c-49bc-4b3d-97e4-3766c99c8d6f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.672449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf4f6-3360-4742-9583-d9dc502fd23c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.694633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:20.711436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f68f-682c-42d4-a602-76bca8043325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.712132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f68f-682c-42d4-a602-76bca8043325 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.712452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f68f-682c-42d4-a602-76bca8043325 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.712814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f68f-682c-42d4-a602-76bca8043325 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.713501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f68f-682c-42d4-a602-76bca8043325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:20.713831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f68f-682c-42d4-a602-76bca8043325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.715264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f68f-682c-42d4-a602-76bca8043325 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.729102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 404/818] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:20.735341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d81b4a-44d5-4dfb-ace3-678f4778e338 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.735621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d81b4a-44d5-4dfb-ace3-678f4778e338 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.735891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d81b4a-44d5-4dfb-ace3-678f4778e338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.745347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:20.757372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f1d81b4a-44d5-4dfb-ace3-678f4778e338 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:20.758709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f1d81b4a-44d5-4dfb-ace3-678f4778e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:20.766056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d924c-49bc-4b3d-97e4-3766c99c8d6f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:20.800368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:20.800967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:20.801237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:20.801501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:20.833330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 405/819] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:20.834231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d81b4a-44d5-4dfb-ace3-678f4778e338 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:20.869190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:20.870696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:20.970184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:20.974315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 415/820] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:23:20.975774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.037109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d81b4a-44d5-4dfb-ace3-678f4778e338 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.063002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:21.110168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.111853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.112146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.112415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.120830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.122352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:21.137326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:21.138327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:21.139741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 406/821] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:21.140406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.155287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666899b-81c5-4c2a-a3da-3e999b9f31af None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.197123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93f513-6eb0-4164-98c9-b7497206bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.197831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93f513-6eb0-4164-98c9-b7497206bf89 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.198114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93f513-6eb0-4164-98c9-b7497206bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.198857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93f513-6eb0-4164-98c9-b7497206bf89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.211089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93f513-6eb0-4164-98c9-b7497206bf89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.213070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93f513-6eb0-4164-98c9-b7497206bf89 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.248800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80943b-2bba-4178-a38c-99e12ebb69cb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.288602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.289243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.289514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.289780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] PATH_INFO: `/v3/services/network` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.290393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.291788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:21.301673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:21.302771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:21.303600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 407/822] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:21 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:21.306070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.343708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1d93f513-6eb0-4164-98c9-b7497206bf89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:21.348152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:21.349114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:21.350033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:21.350033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:21.350033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:21.350033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 416/823] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:21.350778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954682-e659-4e2d-808e-c30193baaa06 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.351048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954682-e659-4e2d-808e-c30193baaa06 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.351309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954682-e659-4e2d-808e-c30193baaa06 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.357234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 417/824] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:21.357234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954682-e659-4e2d-808e-c30193baaa06 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.395363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:21.422222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61422-4cfc-4e34-8ded-f1abe52e9392 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.459215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.459813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.460091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.460360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.461042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:21.461342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.462813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.464562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954682-e659-4e2d-808e-c30193baaa06 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.480344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 408/825] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:21.480344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.497542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaccbd-93cb-4971-95e0-ddd96e181f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.498177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaccbd-93cb-4971-95e0-ddd96e181f2e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.498505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaccbd-93cb-4971-95e0-ddd96e181f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.498816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaccbd-93cb-4971-95e0-ddd96e181f2e None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.499375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaccbd-93cb-4971-95e0-ddd96e181f2e None admin] RBAC: Adding query filter params (name=network) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:21.499788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaccbd-93cb-4971-95e0-ddd96e181f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.501021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaccbd-93cb-4971-95e0-ddd96e181f2e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.505705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 418/826] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:21.511268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe2c1-8339-474b-8fc5-e7fe30b7179e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.511510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe2c1-8339-474b-8fc5-e7fe30b7179e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.511779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fe2c1-8339-474b-8fc5-e7fe30b7179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.529374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c21fe2c1-8339-474b-8fc5-e7fe30b7179e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:21.530598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c21fe2c1-8339-474b-8fc5-e7fe30b7179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:21.578393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:21.585313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f311b-685c-4f93-998f-d6d17d68cb76 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.613925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 419/827] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:21.613925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe2c1-8339-474b-8fc5-e7fe30b7179e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.635352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.635961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.636234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.636497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.637122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:21.637419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.638824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.646806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:21.651592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 409/828] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:21.652571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.725401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fe2c1-8339-474b-8fc5-e7fe30b7179e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.765722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.766436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.766706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.766968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/20cb8cab884f4c1ab8a365b944df70e9/roles/d7d221ea917b4de09e35c98f4ecc0b9e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.785617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a67e-f570-4492-bf12-0de0b44411b0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.789374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=20cb8cab884f4c1ab8a365b944df70e9, role_id=d7d221ea917b4de09e35c98f4ecc0b9e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.791017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.808982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 420/829] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:23:21 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/20cb8cab884f4c1ab8a365b944df70e9/roles/d7d221ea917b4de09e35c98f4ecc0b9e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:23:21.810090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.828361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.829189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.829557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.829947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.830898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] RBAC: Adding query filter params (type=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:21.831287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:21.832883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:21.838686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 410/830] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:21.844944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:21.874871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:21.914497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:21.941937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37364aa3-9790-417d-8bb0-1648ae3fdfdb None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:21.994260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:21.994839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:21.995108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:21.995371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:21.999989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4742f-b161-4fc0-8900-ebc1898ede96 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.004081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.005585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:22.019943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:22.021015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:22.021967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 421/831] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:22.022511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:22.050374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.051041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.051310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.051855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.052292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.053689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:22.084429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 411/832] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:22.085597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:22.150401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017d7a1-8230-4432-beef-c4a311c8fb87 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.199902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.201008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.201895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.202362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.204860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:22.206544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:22.220886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:22.226870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:22.227865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:22.228714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:22.231666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 422/833] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:22.239037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:22.245789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2fca7-8533-4158-beb1-295d816b7662 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.366336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.367807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.367807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.367807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.368160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:22.368756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.371052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:22.374392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e3f4-881e-4922-8760-ffa1a7e029ea None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.389419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 412/834] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:22.394976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:22.414979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.415537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.415808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.416125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.417015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:22.417209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.418602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:22.428794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 423/835] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:22.437015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:22.497591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:22.526792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07a09-d2d3-4c00-a788-8191b92037e4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.544412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e70d-2789-4891-8ed8-56d87abd2930 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.567757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.568366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.568792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.569059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.570139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=e45d799ba78f4adc82f3ffdc9293ff20) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:22.570706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.572608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:22.577990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:22.580871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 413/836] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:22 2022] GET /identity/v3/role_assignments?user.id=e45d799ba78f4adc82f3ffdc9293ff20&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:22.582120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97764af-353a-4357-a493-33c80ff55a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.582765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97764af-353a-4357-a493-33c80ff55a54 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.583037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97764af-353a-4357-a493-33c80ff55a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.583300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97764af-353a-4357-a493-33c80ff55a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.597204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97764af-353a-4357-a493-33c80ff55a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.598737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97764af-353a-4357-a493-33c80ff55a54 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-c97764af-353a-4357-a493-33c80ff55a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:22.623665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:22.625119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:22.626110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:22.626110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:22.626110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:22.629626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 424/837] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:22.631220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:22.747452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47313adb-a247-4385-80e3-07d2c38a99db None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.747635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47313adb-a247-4385-80e3-07d2c38a99db None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.747894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47313adb-a247-4385-80e3-07d2c38a99db None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.749771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 425/838] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:22.749895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64240d-a2f2-45e3-bc8c-7a4fdc33ed6d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.756007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed98d0-8e58-4df8-bc9f-56cb37e245c9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.756645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed98d0-8e58-4df8-bc9f-56cb37e245c9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.757127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed98d0-8e58-4df8-bc9f-56cb37e245c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.778090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0bed98d0-8e58-4df8-bc9f-56cb37e245c9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:22.779998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0bed98d0-8e58-4df8-bc9f-56cb37e245c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:22.796345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.796955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.797224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.797486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.798153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:22.798447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.799820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:22.812760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 414/839] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:22.820302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:22.876751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 426/840] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:22.888259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:22.940192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c85ca-5f98-4de4-9e59-0ccd0e0a701f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:22.975765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:22.976796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:22.977260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:22.977712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:22.985290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:22.987000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:23.000006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:23.000948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:23:23.001934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:23.004461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 415/841] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:23.010346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed98d0-8e58-4df8-bc9f-56cb37e245c9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:23.052060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:23.116040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed98d0-8e58-4df8-bc9f-56cb37e245c9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:23.150932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:23.151918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:23.152385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:23.152840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:23.153780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:23.154313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:23.156092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:23.156362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.179206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 427/842] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:23.184068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:23.268118 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d70f3-9ac0-4bcb-9f56-c3542d471701 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:23.288718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:23.292788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:23.297531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1adb8-a0d9-4366-8e95-e41a37219120 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:23.310060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:23.310833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:23.311136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:23.311498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:23.312295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:23.314413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:23.327488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:23.328524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:23.329394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 416/843] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:23.335982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:23.341097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:23.341722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:23.342346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:23.342778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:23.421740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:23.423205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.445748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d33c6-6db3-4bd9-b4c0-ef1a78d34751 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:23.480059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:23.480656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:23.480927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:23.481195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:23.481828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:23.482181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:23.483627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.493067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 417/844] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:23.493643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:23.543754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:23.557066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 428/845] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:23:23.558182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:23.562257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:23.634804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67fc9d-453a-4f5c-8c4c-61eabedad3f4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:23.680909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:23.681913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:23.682259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7f7ae-d3da-4826-8597-2fbacabac30b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:23.682973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:23.683433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:23.685278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:23.686054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:23.687623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.702372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 418/846] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:23.731676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:23.732320 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:23.732624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:23.732892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:23.744781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:23.746267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:23.762674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:23.763722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:23.764901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:23.764901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:23.764901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:23.764901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 429/847] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:23.775033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:23.892886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cb71e-5761-4de2-9565-01b712436696 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:23.905055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:23.931583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:23.932579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:23.933066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:23.933525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:23.934391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:23.934886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:23.936605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:23.949867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 419/848] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:23.955976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:24.007544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:24.059740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0b7c3-c727-4a0d-b314-aabf303598ac None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:24.093769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbc9e8-c847-490a-8bce-582235dfb4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:24.094844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc9e8-c847-490a-8bce-582235dfb4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.095317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc9e8-c847-490a-8bce-582235dfb4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.095990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc9e8-c847-490a-8bce-582235dfb4a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.107576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbc9e8-c847-490a-8bce-582235dfb4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:24.109482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbc9e8-c847-490a-8bce-582235dfb4a1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-9ecbc9e8-c847-490a-8bce-582235dfb4a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:24.122698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:24.123787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:24.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:24.127502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 430/849] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:24.133749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:24.233329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40108a-b30c-46fd-b6c9-320b45a2bc65 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.233966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40108a-b30c-46fd-b6c9-320b45a2bc65 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.234433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40108a-b30c-46fd-b6c9-320b45a2bc65 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.236231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 431/850] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:24.239752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8c390-fb78-40c6-89b5-43580b666164 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:24.241661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bdfcd-514b-4cd6-8c0c-b90ce475a55d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.242044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bdfcd-514b-4cd6-8c0c-b90ce475a55d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.242325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bdfcd-514b-4cd6-8c0c-b90ce475a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.261639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-444bdfcd-514b-4cd6-8c0c-b90ce475a55d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:24.262876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-444bdfcd-514b-4cd6-8c0c-b90ce475a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:24.281817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:24.283119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.284010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.284739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.285737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:24.286423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:24.289017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:24.304536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 420/851] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:24.310922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:24.342432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 432/852] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:24.351250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:24.421867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fe53-5eab-40c0-a74f-03c5003da765 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:24.460523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:24.461119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.461386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.461648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.462498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=861b64b65d2642afbacfa20851257333) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:24.462801 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:24.464235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:24.470778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 421/853] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:24 2022] GET /identity/v3/role_assignments?user.id=861b64b65d2642afbacfa20851257333&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:24.602508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bdfcd-514b-4cd6-8c0c-b90ce475a55d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:24.659158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:24.727560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bdfcd-514b-4cd6-8c0c-b90ce475a55d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:24.765862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3a315-77f9-4082-aa9a-56f1fda74476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:24.766861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a315-77f9-4082-aa9a-56f1fda74476 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.767275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a315-77f9-4082-aa9a-56f1fda74476 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.767682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a315-77f9-4082-aa9a-56f1fda74476 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.780685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3a315-77f9-4082-aa9a-56f1fda74476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-cfa3a315-77f9-4082-aa9a-56f1fda74476 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:24.785925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:24.787116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:23:24.788526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:24.791110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 433/854] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:24.797835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:24.886929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a464ea-5ce9-4e2a-99d4-fe54a2b38e8a None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.887148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a464ea-5ce9-4e2a-99d4-fe54a2b38e8a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.887374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a464ea-5ce9-4e2a-99d4-fe54a2b38e8a None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.890838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 434/855] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:24.891896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:24.895007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d7c97-288d-4896-9083-5f3308ca05c6 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.895280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d7c97-288d-4896-9083-5f3308ca05c6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.895548 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d7c97-288d-4896-9083-5f3308ca05c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.899984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853157c4-b70a-4c1a-980b-3b7e583de586 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:24.914031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6c5d7c97-288d-4896-9083-5f3308ca05c6 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:24.915200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6c5d7c97-288d-4896-9083-5f3308ca05c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:24.942729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:24.943571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:24.943846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:24.944505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:24.945436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:24.945738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:24.948114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:24.958964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 422/856] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:24.964846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:24.988171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 435/857] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:25.075725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e57d36-85a5-48ff-af4d-3726ee466248 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.109948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.110573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.110842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.111105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.121910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.126699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:25.139139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:25.141456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:25.143611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:25.143611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:25.143611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:25.143611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 423/858] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:25.149816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d7c97-288d-4896-9083-5f3308ca05c6 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:25.175355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:25.250713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d7c97-288d-4896-9083-5f3308ca05c6 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.260056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:25.271692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:25.288817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.289710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.290149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.290554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.291340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:25.291791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.293291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.305396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 436/859] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:25.311127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:25.388240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc720c-34ee-4874-ac48-4aab46c46927 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.402450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:25.417189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fdbf9-5ccc-4004-9d83-bef0d206ed70 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.435392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.436462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.436737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.437005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.437596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.439049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:25.453109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:25.454186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:25.455075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 424/860] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 30 09:23:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:25.460391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:25.464194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.465077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.465581 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.466078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.475069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.476836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:25.489462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:25.490602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:25.491666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:25.498477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 437/861] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:23:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:25.501278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:25.542442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:25.575444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50f652-1776-4c30-92bb-51d4fb8d0dd0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.621032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35168feb-e5eb-4398-9ab0-eb4d9d34f10c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.625906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b25173-9465-420c-90ba-d1825018121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.626526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b25173-9465-420c-90ba-d1825018121b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.626797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b25173-9465-420c-90ba-d1825018121b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.627619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b25173-9465-420c-90ba-d1825018121b None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.628259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b25173-9465-420c-90ba-d1825018121b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:25.628562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b25173-9465-420c-90ba-d1825018121b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.630397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b25173-9465-420c-90ba-d1825018121b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.637225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 425/862] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:25.643378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b25173-9465-420c-90ba-d1825018121b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:25.658172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.658758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.659021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.659328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.660050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:25.660348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.661743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.680887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 438/863] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 30 09:23:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:25.686768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:25.695886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:25.770168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b25173-9465-420c-90ba-d1825018121b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.805532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.806448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.806884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.807283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.808052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:25.808288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49781d5c-0b36-46f4-b70c-025b4743a689 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:25.808976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.810498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.813117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:25.816405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 426/864] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:25.852798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f0e3-e11e-4206-8a95-78100b3ff594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:25.853726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f0e3-e11e-4206-8a95-78100b3ff594 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:25.854219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f0e3-e11e-4206-8a95-78100b3ff594 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:25.854624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f0e3-e11e-4206-8a95-78100b3ff594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:25.929263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f0e3-e11e-4206-8a95-78100b3ff594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:25.931134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f0e3-e11e-4206-8a95-78100b3ff594 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:25.940226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:26.051088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 439/865] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:23:26.056335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:26.135254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd3ef2-35fd-48ee-b240-c028cb09ce5f None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.135567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd3ef2-35fd-48ee-b240-c028cb09ce5f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.135790 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd3ef2-35fd-48ee-b240-c028cb09ce5f None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.137418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 440/866] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:26.142631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea175-65da-48c2-90ee-5f14de93bbf1 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.142832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea175-65da-48c2-90ee-5f14de93bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.143098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea175-65da-48c2-90ee-5f14de93bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.161126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-beaea175-65da-48c2-90ee-5f14de93bbf1 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:26.161597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e665-d746-4045-a593-5f0de8c466b0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:26.162340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-beaea175-65da-48c2-90ee-5f14de93bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:26.200079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:26.201022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.201592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.202186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.214494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:26.216180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:26.231163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:26.232179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:26.233237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:26.233237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:26.233237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:26.239806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 427/868] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:26.239940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 441/868] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:26.241471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea175-65da-48c2-90ee-5f14de93bbf1 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:26.283231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:26.349000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea175-65da-48c2-90ee-5f14de93bbf1 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:26.384015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:26.384933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.385376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.385865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.386665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:26.387129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:26.388645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:26.405240 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 442/869] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:26.406873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:26.464214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:26.512782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1c5b0-d5af-4a23-bfc1-5b723800be73 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:26.546952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:26.547582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.547851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.548115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.555013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:26.556579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:26.568154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:26.569082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:26.570030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:26.573965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 428/870] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:26.575449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:26.591464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:26.700812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:26.710193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890d37-4824-4a58-97a2-1a28390639db None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:26.724710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea7f4-175f-4808-92b4-a5131f03cbc1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:26.747438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:26.747811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873db5b7-f8e6-4d20-ba61-64411ea50106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:26.748520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873db5b7-f8e6-4d20-ba61-64411ea50106 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.748804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873db5b7-f8e6-4d20-ba61-64411ea50106 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.749051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873db5b7-f8e6-4d20-ba61-64411ea50106 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.749915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873db5b7-f8e6-4d20-ba61-64411ea50106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:26.750188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873db5b7-f8e6-4d20-ba61-64411ea50106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:26.751856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873db5b7-f8e6-4d20-ba61-64411ea50106 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:26.767464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 443/871] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:26.769003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ef76-2d19-4144-b101-8cf679e98666 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.769488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ef76-2d19-4144-b101-8cf679e98666 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.770063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ef76-2d19-4144-b101-8cf679e98666 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.773836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 444/872] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:26.773836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ef76-2d19-4144-b101-8cf679e98666 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:26.777506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e70b-227c-4fd6-8544-92d0b946f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:26.778151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e70b-227c-4fd6-8544-92d0b946f04c None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.778424 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e70b-227c-4fd6-8544-92d0b946f04c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.778689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e70b-227c-4fd6-8544-92d0b946f04c None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.779375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e70b-227c-4fd6-8544-92d0b946f04c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:26.780826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e70b-227c-4fd6-8544-92d0b946f04c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:26.798303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 429/873] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:26 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:23:26.799393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f581-6c73-4c9b-92b8-e840418a4489 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.799676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f581-6c73-4c9b-92b8-e840418a4489 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.799942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f581-6c73-4c9b-92b8-e840418a4489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.819697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b417f581-6c73-4c9b-92b8-e840418a4489 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:26.821223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b417f581-6c73-4c9b-92b8-e840418a4489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:26.909857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 430/874] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:26.934411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ef76-2d19-4144-b101-8cf679e98666 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:26.973004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:26.974008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:26.974482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:26.974967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:26.975899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=20cb8cab884f4c1ab8a365b944df70e9) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:26.976372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:26.978007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:26.984762 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 445/875] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:26 2022] GET /identity/v3/role_assignments?user.id=20cb8cab884f4c1ab8a365b944df70e9&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:27.189260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417f581-6c73-4c9b-92b8-e840418a4489 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:27.288238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:27.292038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417f581-6c73-4c9b-92b8-e840418a4489 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:27.327772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:27.328404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:27.328728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:27.328992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:27.329568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:27.330976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:27.339879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:27.340872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:27.341719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 431/876] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:27.349209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:27.372103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:27.450905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026fcc2-c74b-434a-b8de-da1b1d0f5fca None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:27.485187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5dc28-6f2f-49d8-a76d-33f6978065a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:27.486182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5dc28-6f2f-49d8-a76d-33f6978065a8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:27.486655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5dc28-6f2f-49d8-a76d-33f6978065a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:27.487149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5dc28-6f2f-49d8-a76d-33f6978065a8 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:27.487982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5dc28-6f2f-49d8-a76d-33f6978065a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:27.488475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5dc28-6f2f-49d8-a76d-33f6978065a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:27.490184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5dc28-6f2f-49d8-a76d-33f6978065a8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:27.495427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 446/877] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:27.501875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:27.607897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21436a-49cf-444d-a5dd-722a89911776 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:27.651626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d57b4a-33c3-4442-b389-490672b435ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:27.652497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57b4a-33c3-4442-b389-490672b435ba None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:27.652939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57b4a-33c3-4442-b389-490672b435ba None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:27.653341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57b4a-33c3-4442-b389-490672b435ba None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:27.654211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d57b4a-33c3-4442-b389-490672b435ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:27.654702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d57b4a-33c3-4442-b389-490672b435ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:27.656283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d57b4a-33c3-4442-b389-490672b435ba None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:27.661688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 432/878] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:28.093348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cde0c-142f-4433-ac0f-f0ead696025a None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:28.093904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cde0c-142f-4433-ac0f-f0ead696025a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:28.093904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cde0c-142f-4433-ac0f-f0ead696025a None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:28.095488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 447/879] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:28.100887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512cac-ce5d-4b9e-abe9-aec2dfd5ad9f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:28.101169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512cac-ce5d-4b9e-abe9-aec2dfd5ad9f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:28.101437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512cac-ce5d-4b9e-abe9-aec2dfd5ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:28.119943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ec512cac-ce5d-4b9e-abe9-aec2dfd5ad9f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:28.121130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ec512cac-ce5d-4b9e-abe9-aec2dfd5ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:28.142854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:28.191508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 433/880] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:28.468722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cde0c-142f-4433-ac0f-f0ead696025a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:28.557914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:28.575812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cde0c-142f-4433-ac0f-f0ead696025a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:28.614291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede11820-8eaf-4b97-9853-e717e2747236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:28.614905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11820-8eaf-4b97-9853-e717e2747236 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:28.615179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11820-8eaf-4b97-9853-e717e2747236 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:28.615444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11820-8eaf-4b97-9853-e717e2747236 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:28.616108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede11820-8eaf-4b97-9853-e717e2747236 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:28.617490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede11820-8eaf-4b97-9853-e717e2747236 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:28.636456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 448/881] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:28 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:29.015027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e865-6c21-45e7-a338-e8680593f876 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.015612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e865-6c21-45e7-a338-e8680593f876 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.015847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e865-6c21-45e7-a338-e8680593f876 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.017535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 434/882] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:29.022544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4dc78-adb5-4ee1-9682-bc185c586586 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.022827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4dc78-adb5-4ee1-9682-bc185c586586 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.023097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4dc78-adb5-4ee1-9682-bc185c586586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.041887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b5e4dc78-adb5-4ee1-9682-bc185c586586 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:29.043086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b5e4dc78-adb5-4ee1-9682-bc185c586586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:29.116945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 449/883] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:29.335991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8af8-c42c-4ae2-967d-7683f0c658d2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.336340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8af8-c42c-4ae2-967d-7683f0c658d2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.336519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8af8-c42c-4ae2-967d-7683f0c658d2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.338112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 435/884] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:29.347514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17965-2c40-49b8-912e-45b9ebcf9af3 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.347902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17965-2c40-49b8-912e-45b9ebcf9af3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.348292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17965-2c40-49b8-912e-45b9ebcf9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.366775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2ad17965-2c40-49b8-912e-45b9ebcf9af3 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:29.367969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2ad17965-2c40-49b8-912e-45b9ebcf9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:29.395114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc8af8-c42c-4ae2-967d-7683f0c658d2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:29.437229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:29.442685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 450/885] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:29.507152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc8af8-c42c-4ae2-967d-7683f0c658d2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:29.542703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:29.543754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.544264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.544731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.545601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:29.547261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:29.557338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:29.558514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:29.559418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:29.565873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 436/886] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:29.568480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17965-2c40-49b8-912e-45b9ebcf9af3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:29.671708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17965-2c40-49b8-912e-45b9ebcf9af3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:29.705445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:29.706078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.706349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.706615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.707234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:29.707530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:29.708891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:29.713767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 451/887] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:29.719344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:29.729696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:29.744601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:29.838963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24c8c-3ba6-4e2c-b0c9-e9682fc9af9e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:29.849349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd491a59-e175-4748-a0af-3db0fe1cc93c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:29.870073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:29.886567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:29.887533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.887813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.888081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.900336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:29.900619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:29.901460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:29.901964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:29.902432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:29.903258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:29.903820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:29.905367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:29.906321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:29.907167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:29.908563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:29.910066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 452/888] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 30 09:23:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:29.912639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:29.915582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 437/889] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:29.920927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.027028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:30.040200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658db7-f560-48aa-b0e0-f3811014b7df None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.047976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aa32-d995-4bd1-bc27-b441cc8f4ed6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.065909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:30.078411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecadaf1-0f3e-47ba-98c5-fbe4a8e06a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.079006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecadaf1-0f3e-47ba-98c5-fbe4a8e06a74 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.079287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecadaf1-0f3e-47ba-98c5-fbe4a8e06a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.079554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecadaf1-0f3e-47ba-98c5-fbe4a8e06a74 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.080216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecadaf1-0f3e-47ba-98c5-fbe4a8e06a74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:30.080518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecadaf1-0f3e-47ba-98c5-fbe4a8e06a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.081941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecadaf1-0f3e-47ba-98c5-fbe4a8e06a74 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.085873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc992d2-74bf-4dd3-be2f-fdf2c735c818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.087095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc992d2-74bf-4dd3-be2f-fdf2c735c818 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.087565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc992d2-74bf-4dd3-be2f-fdf2c735c818 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.088017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc992d2-74bf-4dd3-be2f-fdf2c735c818 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.088889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc992d2-74bf-4dd3-be2f-fdf2c735c818 None admin] RBAC: Adding query filter params (interface=public, service_id=9b3b8ab8e2ea431fa3d970511e55a96f, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:30.089382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc992d2-74bf-4dd3-be2f-fdf2c735c818 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.089711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 453/890] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 30 09:23:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:30.090962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479360-478c-4050-8cd0-a44ec2a1d2b7 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.091244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479360-478c-4050-8cd0-a44ec2a1d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.091502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc992d2-74bf-4dd3-be2f-fdf2c735c818 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.091614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479360-478c-4050-8cd0-a44ec2a1d2b7 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.093417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 454/891] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:30.096197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd479360-478c-4050-8cd0-a44ec2a1d2b7 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.098954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 438/892] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:23:29 2022] GET /identity/v3/endpoints?service_id=9b3b8ab8e2ea431fa3d970511e55a96f&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:30.100145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0293c-a52c-438a-9caa-43559f236ee9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.100423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0293c-a52c-438a-9caa-43559f236ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.100688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0293c-a52c-438a-9caa-43559f236ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.120113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-06b0293c-a52c-438a-9caa-43559f236ee9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:30.121600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-06b0293c-a52c-438a-9caa-43559f236ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:30.193161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 439/893] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:30.194372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0293c-a52c-438a-9caa-43559f236ee9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.215603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd479360-478c-4050-8cd0-a44ec2a1d2b7 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.259934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.261534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.262289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.262791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.272358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:30.277480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.279804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:30.296499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:30.297515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:30.298856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:30.298856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:30.298856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:30.298856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 455/894] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:30.302057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0293c-a52c-438a-9caa-43559f236ee9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.313624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.342355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.343485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.344239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.344821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.345699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.347854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.355921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 440/895] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:30 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:23:30.378277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:30.435667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee839-5a65-41f5-9da6-16630afe9787 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.476242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.476783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.477060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.477331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.478014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:30.478313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.479828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.488277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.500443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 456/896] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:30.502190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.601491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb56dd-8fdf-4a0f-8312-0d293e55363e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.625478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d75efa-8c0e-4035-a4e1-4bcde35d93a3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.627334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:30.660689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.661840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.662627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.663675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.664592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.666541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.667645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71bbf8-c113-44fb-adc1-1252de36a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.668371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71bbf8-c113-44fb-adc1-1252de36a562 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.668712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71bbf8-c113-44fb-adc1-1252de36a562 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.669047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71bbf8-c113-44fb-adc1-1252de36a562 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.678554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71bbf8-c113-44fb-adc1-1252de36a562 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.680813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71bbf8-c113-44fb-adc1-1252de36a562 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.693729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 441/897] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:30 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-9e71bbf8-c113-44fb-adc1-1252de36a562 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:30.699998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:30.701982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:30.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:30.710008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 457/898] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:23:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:30.712246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.715765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:30.847239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d94b-d94d-4f81-b27d-7914ac9805fd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:30.885143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da814c-6428-48c3-9338-76dfb856c3b7 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.885718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da814c-6428-48c3-9338-76dfb856c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.886135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da814c-6428-48c3-9338-76dfb856c3b7 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.887782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 458/899] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:30.890642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:30.891269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.891540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.891806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.892531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:30.892829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:30.894305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:30.894412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a377-50af-4599-b739-c3ca825b7b1d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:30.894695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a377-50af-4599-b739-c3ca825b7b1d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:30.895022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a377-50af-4599-b739-c3ca825b7b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:30.917580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 442/900] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 30 09:23:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:30.921461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ed06a377-50af-4599-b739-c3ca825b7b1d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:30.922875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ed06a377-50af-4599-b739-c3ca825b7b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:30.923906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:30.996086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:31.005676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 459/901] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:31.043272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a069-b229-4301-85ec-dabfced20255 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.078189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:31.078791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:31.079061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:31.079324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:31.148362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:31.149739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:31.210617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:31.262556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 443/902] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:23:31.265246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06a377-50af-4599-b739-c3ca825b7b1d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.314623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.360632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:31.374234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06a377-50af-4599-b739-c3ca825b7b1d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.410966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:31.412057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:31.412527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:31.413378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:31.424482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:31.426427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:31.435779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae127d-4b14-475f-861b-8d71a937563c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:31.445260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:31.446296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:31.447247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:31.447247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:31.447247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:31.447247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 460/903] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:31.459195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.483432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:31.484893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:31.485334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:31.485771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:31.486542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:31.488610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:31.501734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:31.502775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:31.503677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:31.512475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 444/904] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:31.513720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.544754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:31.596094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2224e-5def-4a3e-ab7a-37dc86c7c875 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.647499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:31.648262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:31.648862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:31.649293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:31.650494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:31.651013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:31.652858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:31.657108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2a643-401d-4595-b0b7-9fea5e5b784a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.666398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:31.673884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 461/905] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:31.678251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.703770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:31.704538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:31.704928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:31.705282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:31.706093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:31.706426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:31.708069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:31.718468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 445/906] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:31.719706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.784371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d65c-b227-4a33-9a3a-cb20b86b0b24 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.806199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:31.820128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:31.821068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:31.821544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:31.822064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:31.824328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be509de8-0c84-447d-b210-866a0aacaf04 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.829463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:31.831252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:31.842921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:31.843843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:31.844753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:31.847098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 462/907] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:31.853311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.866459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:31.867067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:31.867350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:31.867622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:31.868242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:31.868545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:31.870862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:31.877838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 446/908] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:31.884182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:31.924584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:31.975035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b398c-24bb-454f-88d7-9f4155078712 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:31.996704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51b404-2a83-465b-93b2-705c27a7b0c7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:32.009278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:32.009929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.010199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.010469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:32.011166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:32.011473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:32.012884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:32.025846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 463/909] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:32.033098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:32.046858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:32.046858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.046858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.046858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:32.047688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] RBAC: Adding query filter params (interface=public, service_id=da694bcf45ba42aaabb59fb7014ed29d, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:32.047937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:32.049404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:32.061555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 447/910] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:23:31 2022] GET /identity/v3/endpoints?service_id=da694bcf45ba42aaabb59fb7014ed29d&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:32.063208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:32.079739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:32.142338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95bbd2-4a30-4b21-9998-68a4a7f80228 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:32.162609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:32.177019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d294af4-3cb6-42a6-b206-1847eea272af None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:32.177384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d0baa-4c56-425e-ac0c-a7477242680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:32.178023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d0baa-4c56-425e-ac0c-a7477242680c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.178297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d0baa-4c56-425e-ac0c-a7477242680c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.178622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d0baa-4c56-425e-ac0c-a7477242680c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:32.179344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d0baa-4c56-425e-ac0c-a7477242680c None admin] RBAC: Adding query filter params (role.id=294778c2d48046669d82ab46bd6550d5, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=20cb8cab884f4c1ab8a365b944df70e9) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:32.179696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d0baa-4c56-425e-ac0c-a7477242680c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:32.181805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d0baa-4c56-425e-ac0c-a7477242680c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:32.193826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 464/911] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:32 2022] GET /identity/v3/role_assignments?user.id=20cb8cab884f4c1ab8a365b944df70e9&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=294778c2d48046669d82ab46bd6550d5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:32.223330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd17e5-ef2e-436f-bc7d-34c396ab1937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:32.223961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd17e5-ef2e-436f-bc7d-34c396ab1937 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.224233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd17e5-ef2e-436f-bc7d-34c396ab1937 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.224497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd17e5-ef2e-436f-bc7d-34c396ab1937 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:32.225108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd17e5-ef2e-436f-bc7d-34c396ab1937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:32.226597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd17e5-ef2e-436f-bc7d-34c396ab1937 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:32.233941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 448/912] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:32 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:23:32.555344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0134-544b-443f-b308-f800462a8f34 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.555911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0134-544b-443f-b308-f800462a8f34 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.555911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0134-544b-443f-b308-f800462a8f34 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:32.557414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 465/913] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:32.563247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677438-b1a7-4904-979a-1aca9e2f80ed None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.563525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677438-b1a7-4904-979a-1aca9e2f80ed None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.563793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677438-b1a7-4904-979a-1aca9e2f80ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:32.582690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4e677438-b1a7-4904-979a-1aca9e2f80ed None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:32.583870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4e677438-b1a7-4904-979a-1aca9e2f80ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:32.655031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 449/914] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:32.920086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0134-544b-443f-b308-f800462a8f34 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:32.980662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350904-3eb8-42d1-a3b6-8ddff5927133 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.981006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350904-3eb8-42d1-a3b6-8ddff5927133 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.981211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350904-3eb8-42d1-a3b6-8ddff5927133 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:32.982999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 450/915] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:32.988374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ef32b-d8f6-460d-922e-84445057b9c0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:32.988654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ef32b-d8f6-460d-922e-84445057b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:32.988919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ef32b-d8f6-460d-922e-84445057b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.001081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:33.008312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-732ef32b-d8f6-460d-922e-84445057b9c0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:33.010418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-732ef32b-d8f6-460d-922e-84445057b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:33.028477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0134-544b-443f-b308-f800462a8f34 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:33.069881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:33.070693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:33.071127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:33.071484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.072170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:33.073538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:33.083424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:33.084421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:33.085407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 466/916] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:33.091130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:33.105819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 451/917] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:33.149945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:33.208183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300e51-091f-450e-b01c-1106d59a2399 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:33.247767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:33.248933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:33.249408 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:33.249943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.250767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:33.251275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:33.252838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:33.258718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 467/918] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:33.265871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ef32b-d8f6-460d-922e-84445057b9c0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:33.368754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ef32b-d8f6-460d-922e-84445057b9c0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:33.391710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:33.406067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:33.407143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:33.407982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:33.408453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.409535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:33.410219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:33.412212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:33.415392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:33.419840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 452/919] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 30 09:23:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:33.425595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:33.504708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d280492-539a-4f6e-a242-824fee415340 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:33.523306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:33.531532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18518faa-920a-4231-ba20-631b23486ffa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:33.552182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:33.553218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:33.554263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:33.554747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.555801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:33.558642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:33.568362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:33.569090 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:33.569498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:33.569892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.570655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:33.571638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:33.572821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:33.573842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:33.574626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:33.576622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 468/920] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:33.585627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:33.606881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 453/921] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:33.710949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c461ff1-7985-4d4f-b935-3e947cc87f21 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:33.753922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:33.754539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:33.754867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:33.755141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.755768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:33.756064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:33.757471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:33.763270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 469/922] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:33.769315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:33.831672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:33.880257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3384de-1019-48bb-9d35-42dfc044816f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:33.916480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:33.917087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:33.917366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:33.917636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:33.918300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:33.918601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:33.920198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:33.925717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 454/923] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:33.931723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:33.967897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:34.043807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647750b-a7dd-47f7-84a0-f0e982f5b6ee None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:34.079111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d202-da6e-4f1e-ba3a-bd1b504263af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:34.079732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d202-da6e-4f1e-ba3a-bd1b504263af None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:34.080005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d202-da6e-4f1e-ba3a-bd1b504263af None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:34.080273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d202-da6e-4f1e-ba3a-bd1b504263af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:34.080975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d202-da6e-4f1e-ba3a-bd1b504263af None admin] RBAC: Adding query filter params (interface=public, service_id=c95b66565b924178981926c909bbc3c3, region_id=RegionOne) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:34.081273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d202-da6e-4f1e-ba3a-bd1b504263af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:34.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d202-da6e-4f1e-ba3a-bd1b504263af None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:34.090873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 470/924] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:23:33 2022] GET /identity/v3/endpoints?service_id=c95b66565b924178981926c909bbc3c3&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:34.096840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:34.208216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310802-494a-4a66-baa6-2ed734e6438b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:34.228228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:34.242134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc548d-2e2a-43ad-bd43-8c00cb42f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:34.242739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc548d-2e2a-43ad-bd43-8c00cb42f990 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:34.243008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc548d-2e2a-43ad-bd43-8c00cb42f990 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:34.243272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc548d-2e2a-43ad-bd43-8c00cb42f990 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:34.243868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc548d-2e2a-43ad-bd43-8c00cb42f990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:34.245249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc548d-2e2a-43ad-bd43-8c00cb42f990 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:34.251685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 455/925] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:34 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:23:34.481593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0654a-d3e3-47be-a558-6b58acc2e401 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:34.481788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0654a-d3e3-47be-a558-6b58acc2e401 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:34.482097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0654a-d3e3-47be-a558-6b58acc2e401 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:34.483908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 471/926] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:34.489332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0d38-9ec6-483b-a5ce-e0a5c1f59f09 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:34.489615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0d38-9ec6-483b-a5ce-e0a5c1f59f09 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:34.489910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0d38-9ec6-483b-a5ce-e0a5c1f59f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:34.509577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ce3e0d38-9ec6-483b-a5ce-e0a5c1f59f09 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:34.510807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ce3e0d38-9ec6-483b-a5ce-e0a5c1f59f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:34.510932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fddc3-8534-4b3b-bb1c-a18562360fbd None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:34.511124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fddc3-8534-4b3b-bb1c-a18562360fbd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:34.511344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fddc3-8534-4b3b-bb1c-a18562360fbd None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:34.513009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 472/927] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:34.518271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8cd21-64a7-43b9-9eb7-813dba07d576 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:34.518533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8cd21-64a7-43b9-9eb7-813dba07d576 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:34.518802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8cd21-64a7-43b9-9eb7-813dba07d576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:34.536846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4ed8cd21-64a7-43b9-9eb7-813dba07d576 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:34.538446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4ed8cd21-64a7-43b9-9eb7-813dba07d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:34.605951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 456/928] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:34.621241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 473/929] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:34.869828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0d38-9ec6-483b-a5ce-e0a5c1f59f09 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:34.890438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8cd21-64a7-43b9-9eb7-813dba07d576 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:34.921365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:34.986482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0d38-9ec6-483b-a5ce-e0a5c1f59f09 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:34.992484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8cd21-64a7-43b9-9eb7-813dba07d576 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.002242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:35.023641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.024800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.025335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.025774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.026626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.027228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.027955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.028319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.028675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.028793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:35.038985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:35.039982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:23:35.040903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:35.041670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:35.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:35.049397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:35.050284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:35.051432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 457/931] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 30 09:23:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:35.052125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 474/931] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 30 09:23:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:35.053209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.053324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.155734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412227-782f-4bf1-956c-29bf1cbb66b1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.159218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348b58-d74f-469e-96bd-064e66f83f99 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.164291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:35.195920 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.197013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.197485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.198064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.198412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.199019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.199288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.199540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:35.199640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.200127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.200237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:35.200465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.201907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.202338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.212361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 458/933] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:35.213948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.215432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 475/933] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:35.216667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.257709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:35.315745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abad9e-a055-4c74-a19a-297132ed44d9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.321454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da429dae-6ef5-4150-99c7-1d2a326249b2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.352877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.353835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.354423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.354826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.355610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:35.355967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.357603 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.358527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.359520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.360294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.360754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.368361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 459/934] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:35.370741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.375702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.377262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:35.394150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:35.395143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:35.396159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:35.396159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:35.396159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:35.397875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 476/935] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:35.402130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.406063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:35.482654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d5770-b698-44a2-b2f7-fd5f653ff32b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.490309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:35.517095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6a21-191e-485a-a439-27d00ab2b152 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.520028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.520930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.521400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.521965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.522838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.524431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.558190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 460/936] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:35.567401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.568077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.568397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.568664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.569356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:35.569658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.571227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.590587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 477/937] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:35.592339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.706231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ce3c-d7af-4ced-9f63-942407aba44c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.744289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368021ab-2824-4b6c-be87-7493c80cc4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.744929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368021ab-2824-4b6c-be87-7493c80cc4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.745200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368021ab-2824-4b6c-be87-7493c80cc4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.745464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368021ab-2824-4b6c-be87-7493c80cc4d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.755880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368021ab-2824-4b6c-be87-7493c80cc4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.756514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368021ab-2824-4b6c-be87-7493c80cc4d2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-368021ab-2824-4b6c-be87-7493c80cc4d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:35.769662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:35.770677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:35.771635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:35.774193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 461/938] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:35.777479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.844972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:35.886593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868207-41ab-4f4b-9d9d-ac25081797b3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:35.902029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ddc65-2c7c-409b-99ba-a4a017932a2a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.902635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ddc65-2c7c-409b-99ba-a4a017932a2a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.903098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ddc65-2c7c-409b-99ba-a4a017932a2a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.906111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 462/939] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:35.910532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fba71-20c5-4c23-b7c5-95b13cf8a367 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.911028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fba71-20c5-4c23-b7c5-95b13cf8a367 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.911488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fba71-20c5-4c23-b7c5-95b13cf8a367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.921661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:35.922317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:35.922591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:35.922858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:35.923584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:35.923886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:35.925305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:35.933930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6e2fba71-20c5-4c23-b7c5-95b13cf8a367 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:35.935436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6e2fba71-20c5-4c23-b7c5-95b13cf8a367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:35.944286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 478/940] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:35.952647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:35.961095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:36.041900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 463/941] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:36.082481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060313a-8912-48dc-bac4-86b58753b9f9 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.100812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:36.119153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.119801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.120073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.120341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.130965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:36.132470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:36.147389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:36.148377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:36.149429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:36.149429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:36.149429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:36.149429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 479/942] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:36.156147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fba71-20c5-4c23-b7c5-95b13cf8a367 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.264379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fba71-20c5-4c23-b7c5-95b13cf8a367 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.301003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.301611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.301907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.302175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.302811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:36.303107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:36.304487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:36.316866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 464/943] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:36.322610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.329504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.348938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:36.436159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a3ffa-03db-4136-842d-459a8c538dfd None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.465948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7255bd-f3fc-4d8e-a35a-19f3870bf489 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.471483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a775-b48c-4a3f-aed1-1e2e83480b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.472372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a775-b48c-4a3f-aed1-1e2e83480b47 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.472859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a775-b48c-4a3f-aed1-1e2e83480b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.473429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a775-b48c-4a3f-aed1-1e2e83480b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.481004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a775-b48c-4a3f-aed1-1e2e83480b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:36.482796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a775-b48c-4a3f-aed1-1e2e83480b47 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-03f1a775-b48c-4a3f-aed1-1e2e83480b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:36.494933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:36.495851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:36.496743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:36.503452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 480/944] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:36.503452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f61e-be96-4207-b692-7955e5d865aa None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.503452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f61e-be96-4207-b692-7955e5d865aa None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.503452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f61e-be96-4207-b692-7955e5d865aa None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.504525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 481/945] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:36.506556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844f61e-be96-4207-b692-7955e5d865aa None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.507572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.508187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.508487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.508720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.509364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:36.510879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:36.513644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING keystone.server.flask.common [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 30 09:23:36.533595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.sql.core [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:23:36.533595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 09:23:36.533595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [parameters: {'id': '5112da20e4964f3e80aad5e865a29fa3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 09:23:36.533595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-272b9d3d-e841-455a-b8e8-b1168fe53914 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5112da20e4964f3e80aad5e865a29fa3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5112da20e4964f3e80aad5e865a29fa3. Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:23:36.540695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 30 09:23:36.541494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application yield resource Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise self.value Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application session.commit() Sep 30 09:23:36.542517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:23:36.543429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:23:36.544365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:23:36.547695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [parameters: {'id': '5112da20e4964f3e80aad5e865a29fa3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:36.550034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:36.552123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5112da20e4964f3e80aad5e865a29fa3. Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 465/946] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 30 09:23:36 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e4b8-4a80-4a17-81d2-37d1e32ec70a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.554698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e4b8-4a80-4a17-81d2-37d1e32ec70a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.557220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e4b8-4a80-4a17-81d2-37d1e32ec70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.558174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:36.570039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5274e4b8-4a80-4a17-81d2-37d1e32ec70a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:36.571569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5274e4b8-4a80-4a17-81d2-37d1e32ec70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:36.624070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844f61e-be96-4207-b692-7955e5d865aa None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.636179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:36.645943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 466/947] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:36.647087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e4b8-4a80-4a17-81d2-37d1e32ec70a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.667783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.668389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.668666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.668921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.669648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:36.670023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:36.672196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:36.694023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 482/948] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:36.696114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.761233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e4b8-4a80-4a17-81d2-37d1e32ec70a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.797179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.798134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.798584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.799091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.806323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:36.808198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:36.812587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:36.820922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:36.821864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:36.822760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:36.823195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8ca07-4237-4004-9547-516d0ac58286 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.830279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 467/949] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:36.831843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.864865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.865537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.865843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.866659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/20cb8cab884f4c1ab8a365b944df70e9/roles/294778c2d48046669d82ab46bd6550d5` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:36.869329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=20cb8cab884f4c1ab8a365b944df70e9, role_id=294778c2d48046669d82ab46bd6550d5)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:36.872056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:36.891812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 483/950] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:23:36 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/20cb8cab884f4c1ab8a365b944df70e9/roles/294778c2d48046669d82ab46bd6550d5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:23:36.909535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:36.913271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:36.957151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6e70-a959-43ee-8e85-8c99edabf056 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:36.998186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:36.998916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:36.999106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:36.999444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:37.000153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:37.000457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:37.001961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:37.038903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 468/951] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:37.053740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af63beb-bc35-492f-b721-c91316d100ee None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:37.096122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:37.096778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:37.097055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:37.097326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:37.097953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:37.099405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:37.109256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:37.110368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:37.111375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 484/952] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:37.117119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:37.233600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333887a1-596c-4511-bc87-c448af8fb1b4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:37.252385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:37.270368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:37.271032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:37.271280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:37.271488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:37.272104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:37.272398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:37.273761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:37.285222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 469/953] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:37.286601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:37.304166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:37.389998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a7aa-8911-4cb6-bcd3-00a8ea883df0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:37.424693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222874ce-5cb3-4933-8714-5b09e88ea5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:37.425303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222874ce-5cb3-4933-8714-5b09e88ea5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:37.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222874ce-5cb3-4933-8714-5b09e88ea5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:37.425861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222874ce-5cb3-4933-8714-5b09e88ea5b2 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:37.426484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222874ce-5cb3-4933-8714-5b09e88ea5b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:37.426776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222874ce-5cb3-4933-8714-5b09e88ea5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:37.428139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222874ce-5cb3-4933-8714-5b09e88ea5b2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:37.437916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 485/954] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:37.439412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:37.547808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785e63f-6ee1-41bc-9614-2fa13be95036 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:37.584236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9fc64-bc81-4ab8-b611-c6815b0f1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:37.585243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc64-bc81-4ab8-b611-c6815b0f1bef None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:37.585743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc64-bc81-4ab8-b611-c6815b0f1bef None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:37.586257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc64-bc81-4ab8-b611-c6815b0f1bef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:37.587127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9fc64-bc81-4ab8-b611-c6815b0f1bef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:37.588702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9fc64-bc81-4ab8-b611-c6815b0f1bef None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:37.616174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 470/955] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:37.796824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70e181-ccf3-4110-a152-5c27591ab0f8 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:37.797097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70e181-ccf3-4110-a152-5c27591ab0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:37.797364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70e181-ccf3-4110-a152-5c27591ab0f8 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:37.799046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 486/956] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:37.804582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a85be-0a3a-4305-910f-6680bdb21fc3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:37.804862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a85be-0a3a-4305-910f-6680bdb21fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:37.805128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a85be-0a3a-4305-910f-6680bdb21fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:37.823693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c15a85be-0a3a-4305-910f-6680bdb21fc3 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:37.824891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c15a85be-0a3a-4305-910f-6680bdb21fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:37.860964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:37.918738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 471/957] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:38.188896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70e181-ccf3-4110-a152-5c27591ab0f8 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:38.270750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:38.294079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70e181-ccf3-4110-a152-5c27591ab0f8 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:38.327778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:38.328408 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:38.328677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:38.328939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:38.329514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:38.331057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:38.339902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:38.340979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:38.341924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 487/958] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:38.349539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a85be-0a3a-4305-910f-6680bdb21fc3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:38.454765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a85be-0a3a-4305-910f-6680bdb21fc3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:38.491051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e16ae-d5dc-4136-ab86-abbb7f42127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:38.492008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e16ae-d5dc-4136-ab86-abbb7f42127a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:38.492499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e16ae-d5dc-4136-ab86-abbb7f42127a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:38.492984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e16ae-d5dc-4136-ab86-abbb7f42127a None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:38.493827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e16ae-d5dc-4136-ab86-abbb7f42127a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:38.494325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e16ae-d5dc-4136-ab86-abbb7f42127a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:38.495901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e16ae-d5dc-4136-ab86-abbb7f42127a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:38.501583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 472/959] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:38.507660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:38.612513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ec16-9083-4a05-a108-ad9b67ab0201 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:38.648902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fc6c5-dfe0-4993-a3c7-990264770f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:38.649505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc6c5-dfe0-4993-a3c7-990264770f25 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:38.649771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc6c5-dfe0-4993-a3c7-990264770f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:38.650074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc6c5-dfe0-4993-a3c7-990264770f25 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:38.650905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fc6c5-dfe0-4993-a3c7-990264770f25 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:38.651200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fc6c5-dfe0-4993-a3c7-990264770f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:38.652561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fc6c5-dfe0-4993-a3c7-990264770f25 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:38.657741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 488/960] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:39.220469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab889-f977-45a2-89a3-0bef6faf6180 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.220862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab889-f977-45a2-89a3-0bef6faf6180 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.221058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab889-f977-45a2-89a3-0bef6faf6180 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.222675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 473/961] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:39.228069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af23f4-8b9e-42c0-ab67-5f329623ee6e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.228576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af23f4-8b9e-42c0-ab67-5f329623ee6e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.228658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af23f4-8b9e-42c0-ab67-5f329623ee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.241984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:39.251227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-20af23f4-8b9e-42c0-ab67-5f329623ee6e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:39.253034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-20af23f4-8b9e-42c0-ab67-5f329623ee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:39.331386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 489/962] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:39.360742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebba5a0-daae-406b-9538-9ec3b9217a72 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.361691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebba5a0-daae-406b-9538-9ec3b9217a72 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.362206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebba5a0-daae-406b-9538-9ec3b9217a72 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.364031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 474/963] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:39.371445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a67b-a519-4ddb-8c16-cb4c9c35fd24 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.371976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a67b-a519-4ddb-8c16-cb4c9c35fd24 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.372449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a67b-a519-4ddb-8c16-cb4c9c35fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.391668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5a55a67b-a519-4ddb-8c16-cb4c9c35fd24 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:39.393565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5a55a67b-a519-4ddb-8c16-cb4c9c35fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:39.463350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 490/964] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:39.603896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebba5a0-daae-406b-9538-9ec3b9217a72 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:39.642131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:39.718355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebba5a0-daae-406b-9538-9ec3b9217a72 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:39.734869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a67b-a519-4ddb-8c16-cb4c9c35fd24 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:39.755805 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:39.756441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.756780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.757067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.768610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:39.773978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:39.774904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:39.775757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 475/965] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 30 09:23:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:39.783832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:39.814121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:39.860274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a67b-a519-4ddb-8c16-cb4c9c35fd24 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:39.893942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:39.908340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:39.909296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.909404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83770-7aa1-4933-93c4-5d3d9569a94a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:39.909896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.910399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.911222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:39.913024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:39.915616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING keystone.server.flask.common [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 30 09:23:39.928826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.sql.core [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:23:39.928826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 09:23:39.928826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [parameters: {'user_id': 'bfa2aefb28d04eff8074627f95fa9f93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 09:23:39.928826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81731) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:23:39.945086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dd5f5-d815-49ea-96e0-471d4295f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-a73f4d2c-e3f8-4ac5-939f-542556df203c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application result.read() Sep 30 09:23:39.945278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:23:39.946181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application yield resource Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise self.value Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application session.commit() Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:23:39.947142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:23:39.948107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:23:39.949032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application result.read() Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:23:39.951219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bfa2aefb28d04eff8074627f95fa9f93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:39.953313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 30 09:23:39.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 30 09:23:39.958073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 30 09:23:39.958073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 30 09:23:39.958073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:23:39.958073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:23:39.958073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 09:23:39.958073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:39.959270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dd5f5-d815-49ea-96e0-471d4295f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.959270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dd5f5-d815-49ea-96e0-471d4295f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.959270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dd5f5-d815-49ea-96e0-471d4295f8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.959516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 491/966] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 30 09:23:39 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:39.959516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f149-2c27-4b50-b9c0-6f150a94c8ad None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.959516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f149-2c27-4b50-b9c0-6f150a94c8ad None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.959516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f149-2c27-4b50-b9c0-6f150a94c8ad None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.959806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dd5f5-d815-49ea-96e0-471d4295f8d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:39.959806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dd5f5-d815-49ea-96e0-471d4295f8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:39.959806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dd5f5-d815-49ea-96e0-471d4295f8d2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:39.960030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 492/967] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:39.960030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f149-2c27-4b50-b9c0-6f150a94c8ad None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:39.970024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 476/968] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 30 09:23:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:39.970024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ba774-036b-478c-a63f-254110325e1d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:39.970024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ba774-036b-478c-a63f-254110325e1d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:39.970024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ba774-036b-478c-a63f-254110325e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:39.987215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d17ba774-036b-478c-a63f-254110325e1d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:39.988383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d17ba774-036b-478c-a63f-254110325e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:40.057689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 477/969] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:40.062882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ba774-036b-478c-a63f-254110325e1d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.077877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f149-2c27-4b50-b9c0-6f150a94c8ad None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.112816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.125635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.126309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.126584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.126853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.136462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.138787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:40.152660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:40.153745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:23:40.155077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:40.157943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 493/970] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:40.159744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.168012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.193081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ba774-036b-478c-a63f-254110325e1d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.233917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.234806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.235228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.235639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.246940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.248638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:40.264775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:40.266039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:40.267224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:40.267224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:40.267224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:40.273525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 478/971] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:40.274577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.279544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0459-4f2f-429e-be94-1f16ccfac456 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.317179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.318008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.318381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.318749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.319551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:40.320688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.321570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.357354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 494/972] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:40.357941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.397174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15ae69-f384-4e48-acf8-863d64afd414 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.422074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.438765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.447384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.448693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.449914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.450420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.451709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:40.452225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.455304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.477519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 479/973] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:40.478773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.503483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dc2c8-aba5-48eb-a8c2-bbe9844ce020 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.553517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.554616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.554887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.555146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.555722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.557737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:40.570972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:40.572048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:40.572924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 495/974] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:40.579896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.601703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf0b37-a29e-4215-980b-75678afa08fd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.643828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.644573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.644838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.645106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.654522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.655926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:40.670207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:40.671214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:40.672170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 480/975] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:40.677230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.711942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ca41d-c491-4e7b-9690-15ba251af900 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.723450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.739847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.750401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.751011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.751282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.751544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.752161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:40.752454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.753826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.758967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 496/976] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:40.764550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.792702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32eb49-0cc7-49a2-9c2f-01462ceaf498 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.835421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.836025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.836301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.836567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.837289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:40.837627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.839050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.856665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 481/977] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:40.862524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.875593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6e31-bae9-4419-b1b5-77829835dc00 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.910928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafd75e-5973-4fea-9f10-ffa264f7fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:40.911457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd75e-5973-4fea-9f10-ffa264f7fa58 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.911733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd75e-5973-4fea-9f10-ffa264f7fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.912008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd75e-5973-4fea-9f10-ffa264f7fa58 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.912994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafd75e-5973-4fea-9f10-ffa264f7fa58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:40.913292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafd75e-5973-4fea-9f10-ffa264f7fa58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:40.914697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafd75e-5973-4fea-9f10-ffa264f7fa58 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:40.919399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 497/978] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:40.920597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7476a-dbdc-410b-8be1-9c594d1aee08 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:40.920882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7476a-dbdc-410b-8be1-9c594d1aee08 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:40.921154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7476a-dbdc-410b-8be1-9c594d1aee08 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:40.922357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 498/979] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:40.926672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7476a-dbdc-410b-8be1-9c594d1aee08 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:40.964415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54850226-9663-48e9-9098-2a2e99bdae08 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:40.965614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.976023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:40.999716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.000290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.000566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.000829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.028120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7476a-dbdc-410b-8be1-9c594d1aee08 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:41.060615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9133969-b5aa-4c2b-b5fc-fd1cc4d45ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.061211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133969-b5aa-4c2b-b5fc-fd1cc4d45ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.061481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133969-b5aa-4c2b-b5fc-fd1cc4d45ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.061747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133969-b5aa-4c2b-b5fc-fd1cc4d45ba5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.062511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9133969-b5aa-4c2b-b5fc-fd1cc4d45ba5 None admin] RBAC: Adding query filter params (interface=admin, service_id=c95b66565b924178981926c909bbc3c3, region_id=RegionOne) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:41.062812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9133969-b5aa-4c2b-b5fc-fd1cc4d45ba5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.064200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9133969-b5aa-4c2b-b5fc-fd1cc4d45ba5 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.066546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.067980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.068993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 499/980] 10.222.0.20 () {56 vars in 1249 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/endpoints?service_id=c95b66565b924178981926c909bbc3c3&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:41.070134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8110cb-dd26-4894-87fd-02748b7578b7 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.071107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8110cb-dd26-4894-87fd-02748b7578b7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.071107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8110cb-dd26-4894-87fd-02748b7578b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.088544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0c8110cb-dd26-4894-87fd-02748b7578b7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:41.090071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0c8110cb-dd26-4894-87fd-02748b7578b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:41.153949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 500/981] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:41.154839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8110cb-dd26-4894-87fd-02748b7578b7 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:41.173909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 482/982] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:40 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:23:41.179391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:41.191255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:41.195783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:41.264791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8110cb-dd26-4894-87fd-02748b7578b7 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:41.288162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39390b33-f6ff-4d84-aadd-90cc97da680d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:41.302401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.303444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.303729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.304004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.304609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.306022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.322364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 501/983] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:41 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:23:41.323529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.324183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.324453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.324713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.336728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.338253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:41.354912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:41.355950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:41.356883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:41.356883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:41.356883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:41.356883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 483/984] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:41.362081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:41.423072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:41.488220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:41.491505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:41.501460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b232fa-0ad4-4430-a5a3-c1ec20f7db4b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:41.549440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee8d1-1468-46a9-a0ef-a583ea4c91e1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:41.555109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.555734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.556011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.556278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.556924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:41.557217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.558636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.573878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 502/985] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:41.578626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:41.587276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.588178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.588768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.589034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.589699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.591250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.630403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 484/986] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:41 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:23:41.694249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc743-b658-4f36-9831-8df3b164b8c1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:41.740352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.741388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.741932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.742429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.751145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.753022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:41.766614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:41.767659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:41.768608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:41.776129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 503/987] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:41.778034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:41.892438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7d18-17b3-4499-a8cf-23d1ceddc086 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:41.915046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:41.929088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75174-23e6-409c-9c6f-3dea9c90683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:41.929691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75174-23e6-409c-9c6f-3dea9c90683f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:41.929991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75174-23e6-409c-9c6f-3dea9c90683f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:41.930255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75174-23e6-409c-9c6f-3dea9c90683f None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:41.930933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75174-23e6-409c-9c6f-3dea9c90683f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:41.931235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75174-23e6-409c-9c6f-3dea9c90683f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:41.932657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75174-23e6-409c-9c6f-3dea9c90683f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:41.945727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 485/988] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:41.951763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:41.968486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:42.060998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e27ee5-cc0d-4f3a-b0a9-21f416b77785 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:42.095922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c26f-37a2-4798-be4c-f050a1178297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:42.096531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c26f-37a2-4798-be4c-f050a1178297 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:42.096805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c26f-37a2-4798-be4c-f050a1178297 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:42.097073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c26f-37a2-4798-be4c-f050a1178297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:42.097809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c26f-37a2-4798-be4c-f050a1178297 None admin] RBAC: Adding query filter params (role.id=294778c2d48046669d82ab46bd6550d5, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=20cb8cab884f4c1ab8a365b944df70e9) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:42.098125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c26f-37a2-4798-be4c-f050a1178297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:42.099557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c26f-37a2-4798-be4c-f050a1178297 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:42.113823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 504/989] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:41 2022] GET /identity/v3/role_assignments?user.id=20cb8cab884f4c1ab8a365b944df70e9&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=294778c2d48046669d82ab46bd6550d5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:43.490512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e0d1e-0c2b-4911-88dd-e37812fe28a3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:43.491099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e0d1e-0c2b-4911-88dd-e37812fe28a3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:43.491099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e0d1e-0c2b-4911-88dd-e37812fe28a3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:43.492564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 486/990] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:43.498067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccb14-f0a9-4997-9f44-b3755e78bfeb None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:43.498067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccb14-f0a9-4997-9f44-b3755e78bfeb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:43.498556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccb14-f0a9-4997-9f44-b3755e78bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:43.516807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c84ccb14-f0a9-4997-9f44-b3755e78bfeb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:43.518019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c84ccb14-f0a9-4997-9f44-b3755e78bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:43.587408 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 505/991] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:43.789685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2afa0-ddae-4c97-bb81-e90a020faaec None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:43.790107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2afa0-ddae-4c97-bb81-e90a020faaec None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:43.790200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2afa0-ddae-4c97-bb81-e90a020faaec None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:43.791754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 487/992] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:43.796989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a08621-e985-4d2a-aa2c-cb944f68f7c9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:43.797251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a08621-e985-4d2a-aa2c-cb944f68f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:43.797534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a08621-e985-4d2a-aa2c-cb944f68f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:43.810796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:43.816481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-19a08621-e985-4d2a-aa2c-cb944f68f7c9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:43.818049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-19a08621-e985-4d2a-aa2c-cb944f68f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:43.849284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2afa0-ddae-4c97-bb81-e90a020faaec None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:43.886832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 506/993] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:43.958112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2afa0-ddae-4c97-bb81-e90a020faaec None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:43.991895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:43.992525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:43.992798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:43.993063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:43.993651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:43.995060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:44.004341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:44.005343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:44.011043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 488/994] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 30 09:23:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:44.011868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a08621-e985-4d2a-aa2c-cb944f68f7c9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.115749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a08621-e985-4d2a-aa2c-cb944f68f7c9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.149461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.150174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.150446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.150719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.151366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:44.151664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.153091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.155545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:44.165066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 507/995] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:44.166529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.179899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.217298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:44.276959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c6d2b-e21e-4019-aa41-e7ae1bf570ac None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.286238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb91ee-99bf-42cb-99ee-b1cdab5de6c0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.310437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc88de4-b3e3-40ca-b0ac-99b8c88b3b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.311029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88de4-b3e3-40ca-b0ac-99b8c88b3b0e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.311297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88de4-b3e3-40ca-b0ac-99b8c88b3b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.311558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc88de4-b3e3-40ca-b0ac-99b8c88b3b0e None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.312175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc88de4-b3e3-40ca-b0ac-99b8c88b3b0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:44.312466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc88de4-b3e3-40ca-b0ac-99b8c88b3b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.313849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc88de4-b3e3-40ca-b0ac-99b8c88b3b0e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.318613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 489/996] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:44.320064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70db9c7-bd86-4738-b636-6795a43756b7 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.320350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70db9c7-bd86-4738-b636-6795a43756b7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.320685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70db9c7-bd86-4738-b636-6795a43756b7 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.321888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 490/997] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:44.324570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c52edc-711b-4bb1-a180-21c9de31a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.324707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70db9c7-bd86-4738-b636-6795a43756b7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.325212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c52edc-711b-4bb1-a180-21c9de31a09b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.325514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c52edc-711b-4bb1-a180-21c9de31a09b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.325980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c52edc-711b-4bb1-a180-21c9de31a09b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.326488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c52edc-711b-4bb1-a180-21c9de31a09b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.327855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c52edc-711b-4bb1-a180-21c9de31a09b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-e9c52edc-711b-4bb1-a180-21c9de31a09b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:44.336703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:44.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:44.338574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 508/998] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:44.339383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de20b9b-d130-4a7d-a7dc-ba6c90fa61f9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.339383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de20b9b-d130-4a7d-a7dc-ba6c90fa61f9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.339506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de20b9b-d130-4a7d-a7dc-ba6c90fa61f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.357644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2de20b9b-d130-4a7d-a7dc-ba6c90fa61f9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:44.358868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2de20b9b-d130-4a7d-a7dc-ba6c90fa61f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:44.414650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:44.423679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 509/999] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:44.424480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de20b9b-d130-4a7d-a7dc-ba6c90fa61f9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.426416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70db9c7-bd86-4738-b636-6795a43756b7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.439972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:44.470185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.470780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.471070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.471320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.471987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.473359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.491155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 491/1000] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:44.544142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de20b9b-d130-4a7d-a7dc-ba6c90fa61f9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.592424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.593430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.593955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.594391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.595188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:44.595702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.597461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.603495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 510/1001] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:44.609478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.692019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.728024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caa1d4-6831-4b04-80c8-8b3a9e8f7af8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.757142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:44.763565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.764168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.764443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.764708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.765450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:44.765756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.767194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.772564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 492/1002] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:44.778279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.806950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98cfb-3c15-4cfd-8e1d-c0a47625553e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.813319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:44.844804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.845440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.845716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.846008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] PATH_INFO: `/v3/services/image` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.846596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.847961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:44.857147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:44.858269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:44.859143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 511/1003] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:44.864157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.886536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff8adc-cbe8-4433-ab4a-b9cc32c0c35d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.923533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:44.924091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:44.924359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:44.924692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:44.925493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] RBAC: Adding query filter params (interface=public, service_id=dda9789e09de4e499ed1e47b45ddf782, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:44.925610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:44.927011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:44.937078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 493/1004] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/endpoints?service_id=dda9789e09de4e499ed1e47b45ddf782&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:44.938230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:44.974744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036397e5-1bc5-47cc-b2b6-a2fee36ec843 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:44.993098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:45.011550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:45.012160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:45.012436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:45.012695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:45.013401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] RBAC: Adding query filter params (name=image) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:45.013699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:45.015090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:45.020251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 512/1005] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:45.025763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:45.038137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:45.044579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4f5c3-d773-48c7-ad93-2dcfc057d208 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:45.083972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca290b9-18d6-4eab-9af2-b4eb9d4443ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:45.084716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca290b9-18d6-4eab-9af2-b4eb9d4443ae None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:45.084993 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca290b9-18d6-4eab-9af2-b4eb9d4443ae None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:45.085267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca290b9-18d6-4eab-9af2-b4eb9d4443ae None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:45.085904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca290b9-18d6-4eab-9af2-b4eb9d4443ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:45.087287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca290b9-18d6-4eab-9af2-b4eb9d4443ae None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:45.093712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 494/1006] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:44 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:23:45.141437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2daa-d5a1-4943-bf86-e4e9354db3ac None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:45.180471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b48203-473f-4b7b-9377-b1362b825ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:45.181158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b48203-473f-4b7b-9377-b1362b825ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:45.181411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b48203-473f-4b7b-9377-b1362b825ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:45.181688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b48203-473f-4b7b-9377-b1362b825ce3 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:45.182392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b48203-473f-4b7b-9377-b1362b825ce3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:45.182709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b48203-473f-4b7b-9377-b1362b825ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:45.184034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b48203-473f-4b7b-9377-b1362b825ce3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:45.189739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 513/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:46.658151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1aec1-0a75-400c-b2eb-d2466b48b83a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:46.658696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1aec1-0a75-400c-b2eb-d2466b48b83a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:46.658696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1aec1-0a75-400c-b2eb-d2466b48b83a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:46.659986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 495/1008] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:46.665890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5214-bba4-4b9b-b15e-1db87984abd0 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:46.666312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5214-bba4-4b9b-b15e-1db87984abd0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:46.666670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5214-bba4-4b9b-b15e-1db87984abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:46.685214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-adaf5214-bba4-4b9b-b15e-1db87984abd0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:46.686401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-adaf5214-bba4-4b9b-b15e-1db87984abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:46.731059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:46.757559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 514/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:46 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:47.022410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1aec1-0a75-400c-b2eb-d2466b48b83a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:47.127359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1aec1-0a75-400c-b2eb-d2466b48b83a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:47.168388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ae3ca-ec56-416b-a077-d644047d7955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:47.169012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae3ca-ec56-416b-a077-d644047d7955 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.169306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae3ca-ec56-416b-a077-d644047d7955 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.169947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae3ca-ec56-416b-a077-d644047d7955 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.170782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ae3ca-ec56-416b-a077-d644047d7955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:47.172210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ae3ca-ec56-416b-a077-d644047d7955 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:47.174093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 496/1010] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:47.179735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf5214-bba4-4b9b-b15e-1db87984abd0 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:47.251576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a18bb-8001-4300-8d87-8d9d24d5575f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.252035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a18bb-8001-4300-8d87-8d9d24d5575f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.252490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a18bb-8001-4300-8d87-8d9d24d5575f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.255201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 497/1011] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:47.261095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9aac-074b-438b-9ab6-584ab67e8990 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.261510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9aac-074b-438b-9ab6-584ab67e8990 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.261745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9aac-074b-438b-9ab6-584ab67e8990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.281125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3cbf9aac-074b-438b-9ab6-584ab67e8990 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:47.282358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3cbf9aac-074b-438b-9ab6-584ab67e8990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:47.297044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf5214-bba4-4b9b-b15e-1db87984abd0 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:47.308646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:47.333637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:47.334400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.334649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.334920 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.335576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:47.337113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:47.354103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 498/1012] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:47.355528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d56e0-32f5-4f66-b4e4-91f965505afc None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.355713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d56e0-32f5-4f66-b4e4-91f965505afc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.356375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d56e0-32f5-4f66-b4e4-91f965505afc None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.358802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 499/1013] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:47.364823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ecd7a-d86d-484a-8ddd-3021627e0496 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.365151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ecd7a-d86d-484a-8ddd-3021627e0496 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.365420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ecd7a-d86d-484a-8ddd-3021627e0496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.368075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 515/1014] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:47 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:23:47.387460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e35ecd7a-d86d-484a-8ddd-3021627e0496 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:47.388774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e35ecd7a-d86d-484a-8ddd-3021627e0496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:47.466930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 500/1015] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:47.624504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:47.653899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:47.729643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565e0ac-879e-43cf-95c1-6d8e0336748b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:47.732002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ecd7a-d86d-484a-8ddd-3021627e0496 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:47.765535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:47.766204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.766489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.766746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.767322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:47.768677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:47.777849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:47.779172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:47.780037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 516/1016] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:47.784919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:47.833229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:47.845227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ecd7a-d86d-484a-8ddd-3021627e0496 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:47.878460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:47.884011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:47.885030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.885168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.885414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.886138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:47.887562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:47.888615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1832f-ac3a-4451-a89c-41a9664af36c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:47.914013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 501/1017] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:23:47 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:47.932578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:47.933203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:47.933474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:47.933745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:47.934415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:47.934727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:47.936522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:47.942540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 517/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:47.948531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:48.056506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93f73c-364d-4342-9f1a-0f18243a6246 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:48.094082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c344eb-9ddb-4987-9003-b23b5fe05859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:48.094704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c344eb-9ddb-4987-9003-b23b5fe05859 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:48.094976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c344eb-9ddb-4987-9003-b23b5fe05859 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:48.095236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c344eb-9ddb-4987-9003-b23b5fe05859 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:48.095866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c344eb-9ddb-4987-9003-b23b5fe05859 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:48.096166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c344eb-9ddb-4987-9003-b23b5fe05859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:48.097546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c344eb-9ddb-4987-9003-b23b5fe05859 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:48.102939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 502/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 30 09:23:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:48.108889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:48.215549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c4064-3dc7-4960-82b3-c0e45d9aff97 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:48.250194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601f5d-e4fb-4133-98ae-82a1fb599417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:48.250804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f5d-e4fb-4133-98ae-82a1fb599417 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:48.251074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f5d-e4fb-4133-98ae-82a1fb599417 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:48.251335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f5d-e4fb-4133-98ae-82a1fb599417 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:48.252054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601f5d-e4fb-4133-98ae-82a1fb599417 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:48.253689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601f5d-e4fb-4133-98ae-82a1fb599417 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:48.280364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 518/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:49.549291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9d2a-56b7-435c-a322-e200f471dd5c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:49.549871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9d2a-56b7-435c-a322-e200f471dd5c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:49.549871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9d2a-56b7-435c-a322-e200f471dd5c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:49.551382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 503/1021] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:49.556532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c25b-5e10-47ee-9507-dcfadad4b71f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:49.556968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c25b-5e10-47ee-9507-dcfadad4b71f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:49.557146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c25b-5e10-47ee-9507-dcfadad4b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:49.576342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4575c25b-5e10-47ee-9507-dcfadad4b71f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:49.577587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4575c25b-5e10-47ee-9507-dcfadad4b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:49.579707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:49.662182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 519/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:49.930315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9d2a-56b7-435c-a322-e200f471dd5c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:49.946839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:50.040900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9d2a-56b7-435c-a322-e200f471dd5c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:50.074966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511786e0-aa54-4685-9ce0-c96a7b58ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:50.075639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511786e0-aa54-4685-9ce0-c96a7b58ae90 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.075976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511786e0-aa54-4685-9ce0-c96a7b58ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.076248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511786e0-aa54-4685-9ce0-c96a7b58ae90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.077375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511786e0-aa54-4685-9ce0-c96a7b58ae90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:50.078841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511786e0-aa54-4685-9ce0-c96a7b58ae90 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:50.080424 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 504/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:50.086304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575c25b-5e10-47ee-9507-dcfadad4b71f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:50.092395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ee98c-6a67-4b2e-a3cc-7424bca9d9a2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.092674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ee98c-6a67-4b2e-a3cc-7424bca9d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.092944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ee98c-6a67-4b2e-a3cc-7424bca9d9a2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.094314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 505/1024] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:50.099145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d67c0f-96fb-4adb-9344-5c68128ffe5d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.099420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d67c0f-96fb-4adb-9344-5c68128ffe5d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.099686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d67c0f-96fb-4adb-9344-5c68128ffe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.118863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-34d67c0f-96fb-4adb-9344-5c68128ffe5d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:50.120067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-34d67c0f-96fb-4adb-9344-5c68128ffe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:50.196032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575c25b-5e10-47ee-9507-dcfadad4b71f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:50.197905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 506/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:50.232118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd62c0-5106-4e90-be88-747e9a4360c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:50.232685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd62c0-5106-4e90-be88-747e9a4360c0 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.232960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd62c0-5106-4e90-be88-747e9a4360c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.233222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd62c0-5106-4e90-be88-747e9a4360c0 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.233889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd62c0-5106-4e90-be88-747e9a4360c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:50.235302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd62c0-5106-4e90-be88-747e9a4360c0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:50.243476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:50.265831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 520/1026] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:23:50 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:23:50.469473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d67c0f-96fb-4adb-9344-5c68128ffe5d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:50.484077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:50.564282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d938-5949-4b41-b312-125286114f76 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.564811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d938-5949-4b41-b312-125286114f76 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.564811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d938-5949-4b41-b312-125286114f76 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.569778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 521/1027] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:50.571359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b686-0043-4db2-b4da-a218ea5960ac None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.571640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b686-0043-4db2-b4da-a218ea5960ac None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.571906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b686-0043-4db2-b4da-a218ea5960ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.574702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d67c0f-96fb-4adb-9344-5c68128ffe5d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:50.590701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4da7b686-0043-4db2-b4da-a218ea5960ac None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:50.592043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4da7b686-0043-4db2-b4da-a218ea5960ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:50.619101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:50.619997 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.620517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.620707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] PATH_INFO: `/v3/services/image` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.621380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:50.624004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:50.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:50.634047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:50.638834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 507/1028] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 30 09:23:50 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:50.640258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:50.673696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 522/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:50.721725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:50.747229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601faed-9bba-4502-af1a-18d4aec11579 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:50.784642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:50.785248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.785519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.785788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.786439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] RBAC: Adding query filter params (name=image) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:50.786737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:50.788469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:50.793767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 508/1030] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:50.800208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b686-0043-4db2-b4da-a218ea5960ac None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:50.903778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b686-0043-4db2-b4da-a218ea5960ac None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:50.924982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:50.937298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:50.942278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:50.942895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:50.943171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:50.943440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:50.944068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] RBAC: Adding query filter params (type=image) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:50.944365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:50.945746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:50.951405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 523/1031] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:50.957633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:51.053086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0767-d82e-4c07-ae72-2a0f55483d6a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.062339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdada7-5d84-4636-92e5-95d3c31e1a89 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.094998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.095635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.095909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.096178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.097646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.098523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.099160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.099431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.100121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] RBAC: Adding query filter params (interface=public, service_id=9de002d62dd347faa04f9673bbcab5ad, region_id=RegionOne) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:51.100422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:51.101785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:51.103859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:51.108052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:51.108489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 524/1032] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:23:50 2022] GET /identity/v3/endpoints?service_id=9de002d62dd347faa04f9673bbcab5ad&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:51.113456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:51.114562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:51.118941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:51.119590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:51.119666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 509/1033] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 30 09:23:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:51.120893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:51.169118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:51.227153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0773-2006-462d-b8b5-6d002b4f9ef0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.236955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498efc23-4ab6-4508-8a4e-41430aa0630b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.263364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.263971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.264241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.264503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.265154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:51.265689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:51.266850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:51.270632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.271240 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.271512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.271773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.272369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:51.273715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:51.275312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 510/1034] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 30 09:23:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:51.289822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:51.290090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 525/1035] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:23:51 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:23:51.358688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:51.402855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f96165-9273-4cf1-896f-c31e4969da2e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.440093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.440729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.441002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.441261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.452995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:51.454484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:51.475526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:51.476600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:51.477585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:51.477585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:51.477585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:51.481836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 511/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:51.483172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:51.586851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a182-5169-4bda-b113-973f71dbe39b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.600676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:51.628537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.629151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.629428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.629700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.630411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:51.630707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:51.632077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:51.644651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 526/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:51.650561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:51.753538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829179-e1e1-45b4-8722-b35533625a17 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.768066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:51.790133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.790761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.791034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.791301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.799544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:51.800990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:51.812218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:51.813214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:51.814595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:51.818350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 512/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:23:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:51.819508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:51.924882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dafe2b-551e-4374-bc52-4c8ea1e03854 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:51.959547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:51.960157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:51.960432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:51.960700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:51.961423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:51.961724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:51.963195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:51.980970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 527/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:23:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:51.986789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:52.092203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e93b-09b2-4f72-b9a2-f7f6b9a87aa7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:52.126394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ee3f6-eb73-4965-b2ba-6a15cbf8961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:52.126991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee3f6-eb73-4965-b2ba-6a15cbf8961b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.127259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee3f6-eb73-4965-b2ba-6a15cbf8961b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.127523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee3f6-eb73-4965-b2ba-6a15cbf8961b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:52.173006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:52.200896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ee3f6-eb73-4965-b2ba-6a15cbf8961b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:52.202319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ee3f6-eb73-4965-b2ba-6a15cbf8961b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:52.303761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 513/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:51 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:23:52.309487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:52.340065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:52.417129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36f80-dc35-474f-ba44-783dd7fd9989 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:52.451055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:52.451609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.451881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.452146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:52.462268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:52.463712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:52.471075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80e222-72a5-43f6-bf18-b73bda65acba None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.471370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80e222-72a5-43f6-bf18-b73bda65acba None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.471637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80e222-72a5-43f6-bf18-b73bda65acba None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:52.472967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 514/1041] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:52.477911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece8cfb-ff6a-4b77-83a6-6a54bf3321ec None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.478186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece8cfb-ff6a-4b77-83a6-6a54bf3321ec None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.478449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece8cfb-ff6a-4b77-83a6-6a54bf3321ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:52.479155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:52.480080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:52.480998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:52.480998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:52.480998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:52.485179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 528/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:52.486052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:52.497591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dece8cfb-ff6a-4b77-83a6-6a54bf3321ec None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:52.499009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dece8cfb-ff6a-4b77-83a6-6a54bf3321ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:52.571116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:52.577847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 515/1043] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:52.590828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d36b6-07e7-4615-866c-3cd3e895734c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:52.629826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:52.630508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.630770 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.631048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:52.631670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:52.631966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:52.633328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:52.645888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 529/1044] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:52.651554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece8cfb-ff6a-4b77-83a6-6a54bf3321ec None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:52.655218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:52.753559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece8cfb-ff6a-4b77-83a6-6a54bf3321ec None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:52.790862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:52.791489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.791759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.792025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:52.798692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:52.800138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:52.811145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:52.812216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:52.813124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:52.817188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 516/1045] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:52.818503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:52.843624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:52.914328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:52.919700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b788208-1807-4b9c-a3b4-8f9a9758f297 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:52.953596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883bf96-72a6-4f5c-b40f-f938778c5611 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:52.956137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:52.956744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.957016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.957280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:52.957990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:52.958292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:52.959753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:52.977531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 530/1046] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:52.978613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:52.981390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:52.994202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:52.994760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:52.995035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:52.995301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.008127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:53.012804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:53.013902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:53.014772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 517/1047] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:53.019868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:53.097432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230639-c190-47c3-8dce-39c3e290719c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:53.126789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06a6ee-f236-40a2-b99e-fdcb41b44db4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:53.134021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:53.134631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.134900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.135160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.136233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] RBAC: Adding query filter params (role.id=294778c2d48046669d82ab46bd6550d5, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=e45d799ba78f4adc82f3ffdc9293ff20) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:53.136562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:53.138569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:53.150527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 531/1048] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:52 2022] GET /identity/v3/role_assignments?user.id=e45d799ba78f4adc82f3ffdc9293ff20&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=294778c2d48046669d82ab46bd6550d5 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:53.155429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:53.161989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:53.162960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.163235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.163504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.164211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:53.164471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:53.165896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:53.176380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 518/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:53.182724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:53.255463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:53.294335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d8f97-0232-4c60-88da-4da485f02d83 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:53.335444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54336f-82d1-43c0-85e2-838d67d2fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:53.336109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54336f-82d1-43c0-85e2-838d67d2fd90 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.336380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54336f-82d1-43c0-85e2-838d67d2fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.336645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54336f-82d1-43c0-85e2-838d67d2fd90 None admin] PATH_INFO: `/v3/users/a0bc5def25d841158cc590b0634c5060` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.353098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54336f-82d1-43c0-85e2-838d67d2fd90 None admin] RBAC: Authorizing `identity:get_user(user_id=a0bc5def25d841158cc590b0634c5060)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:53.354586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54336f-82d1-43c0-85e2-838d67d2fd90 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:53.356589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 532/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:23:53 2022] GET /identity/v3/users/a0bc5def25d841158cc590b0634c5060 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:53.362449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:53.452714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe838-3edd-40ce-86d8-e820cf47c366 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.453007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe838-3edd-40ce-86d8-e820cf47c366 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.453246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe838-3edd-40ce-86d8-e820cf47c366 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.454650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 533/1051] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:53.460009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b1f74-0c83-4301-9bb2-a13032845f72 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.460289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b1f74-0c83-4301-9bb2-a13032845f72 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.460873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b1f74-0c83-4301-9bb2-a13032845f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.466833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d4b48-c441-44c7-ab10-6fefd086bacd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:53.483800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b36b1f74-0c83-4301-9bb2-a13032845f72 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:53.485160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b36b1f74-0c83-4301-9bb2-a13032845f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:53.502769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:53.503378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.503658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.503923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.556439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 534/1052] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:23:53.563539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:53.578420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:53.579896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:53.699995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 519/1053] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:23:53.701245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b1f74-0c83-4301-9bb2-a13032845f72 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:53.756967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:53.805900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b1f74-0c83-4301-9bb2-a13032845f72 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:53.830440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:53.846147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:53.847163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.847673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.847847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.848977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] RBAC: Authorizing `identity:get_project(project_id=4c5c7001108942869e7bde2e07a201e3)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:53.850457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:53.852242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 535/1054] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:23:53 2022] GET /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:53.858218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:53.920678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:53.938153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553ca7-abf9-4a6f-87b3-42d8549b1944 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:53.966270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14b84e-9f91-42a1-a013-71f3acc63920 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:53.972558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:53.973187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:53.973459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:53.974028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] PATH_INFO: `/v3/services/image` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:53.974339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:53.975703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:53.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:53.986351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:53.987258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 520/1055] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 30 09:23:53 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:53.991970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:53.995335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:54.013921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:54.014879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:54.015303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:54.015724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:54.016873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=4c5c7001108942869e7bde2e07a201e3, user.id=a0bc5def25d841158cc590b0634c5060) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:54.017379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:54.019572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:54.028755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 536/1056] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:23:53 2022] GET /identity/v3/role_assignments?user.id=a0bc5def25d841158cc590b0634c5060&scope.project.id=4c5c7001108942869e7bde2e07a201e3&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:54.140873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17d07b-2dc6-4e15-8169-b6fb5405cd3e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:54.178792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:54.179407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:54.179679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:54.179945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:54.180586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] RBAC: Adding query filter params (name=image) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:54.180872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:54.182323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:54.188171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 521/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:54.194056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:54.300264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda03b4-dca1-474f-97d0-cd38ee453ee0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:54.333951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c44e-b0d4-489c-9aef-ec8e9f38a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:54.334550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c44e-b0d4-489c-9aef-ec8e9f38a533 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:54.334817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c44e-b0d4-489c-9aef-ec8e9f38a533 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:54.335077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c44e-b0d4-489c-9aef-ec8e9f38a533 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:54.335694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c44e-b0d4-489c-9aef-ec8e9f38a533 None admin] RBAC: Adding query filter params (type=image) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:54.335985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c44e-b0d4-489c-9aef-ec8e9f38a533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:54.337324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c44e-b0d4-489c-9aef-ec8e9f38a533 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:54.342366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 537/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:54.347957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:54.364454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:54.453193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e648-cff7-4f92-a662-06e3e91c32bd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:54.486454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218744e3-1edb-4660-82cc-75f23750f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:54.487053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218744e3-1edb-4660-82cc-75f23750f1fe None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:54.487325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218744e3-1edb-4660-82cc-75f23750f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:54.487584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218744e3-1edb-4660-82cc-75f23750f1fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:54.488250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218744e3-1edb-4660-82cc-75f23750f1fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:54.489606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218744e3-1edb-4660-82cc-75f23750f1fe None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:54.516798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 522/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:23:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:23:55.277198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb080-714e-441a-b266-f73f846ef1d7 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:55.277780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb080-714e-441a-b266-f73f846ef1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:55.277780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb080-714e-441a-b266-f73f846ef1d7 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:55.279330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 538/1060] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:55.284530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834221c-9d1a-4e83-96b6-777f7cc661dd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:55.284948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834221c-9d1a-4e83-96b6-777f7cc661dd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:55.285043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834221c-9d1a-4e83-96b6-777f7cc661dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:55.303844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9834221c-9d1a-4e83-96b6-777f7cc661dd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:55.305018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9834221c-9d1a-4e83-96b6-777f7cc661dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:55.367008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:55.381951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 523/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:55.641960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb080-714e-441a-b266-f73f846ef1d7 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:55.695925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:55.747436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb080-714e-441a-b266-f73f846ef1d7 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:55.780851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:55.781475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:55.781744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:55.782021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:55.792960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:55.797834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:55.798772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:55.802767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 539/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 30 09:23:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:55.804986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834221c-9d1a-4e83-96b6-777f7cc661dd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:55.904606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834221c-9d1a-4e83-96b6-777f7cc661dd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:55.939826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:55.940690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:55.941133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:55.941568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:55.942412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:55.942900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:55.944436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:55.952498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 524/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 30 09:23:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:55.958593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.056847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c389-3957-47d3-a082-07232c92d590 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:56.069756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:56.096657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4705-0d3f-4c93-9415-61b8e32da923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:56.097343 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4705-0d3f-4c93-9415-61b8e32da923 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.097614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4705-0d3f-4c93-9415-61b8e32da923 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.097906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4705-0d3f-4c93-9415-61b8e32da923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.108619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4705-0d3f-4c93-9415-61b8e32da923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:56.110080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4705-0d3f-4c93-9415-61b8e32da923 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-89fb4705-0d3f-4c93-9415-61b8e32da923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:56.124087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:56.125055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:56.130837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:56.130837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:56.130837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:56.130837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 540/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:56.131085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.175739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89a7ed-e084-4ce7-bb3c-f6f15379708e None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.175931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89a7ed-e084-4ce7-bb3c-f6f15379708e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.176184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89a7ed-e084-4ce7-bb3c-f6f15379708e None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.177766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 541/1065] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:23:56.182613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad812a0-2b39-4e54-a21d-ddbda49a9e85 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.182882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad812a0-2b39-4e54-a21d-ddbda49a9e85 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.183149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad812a0-2b39-4e54-a21d-ddbda49a9e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.199487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:56.205012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-cad812a0-2b39-4e54-a21d-ddbda49a9e85 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:56.206438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-cad812a0-2b39-4e54-a21d-ddbda49a9e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:56.246042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087e38e-a754-4151-a372-e89940c86be9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:56.279100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 542/1066] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:56.283579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:56.284426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.284917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.285757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.286627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:56.287148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:56.289042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:56.301608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 525/1067] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:56.307191 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad812a0-2b39-4e54-a21d-ddbda49a9e85 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.397636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:56.407203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad812a0-2b39-4e54-a21d-ddbda49a9e85 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:56.443190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:56.443736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.444010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.444276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.451309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:56.452744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:23:56.464017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:56.464978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:56.471175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 543/1068] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:56.473474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.549359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.582240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2bb68-584c-478d-80eb-ddd1eea61392 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:56.602375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:56.626459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:56.627659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.627946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.628212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.629198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:56.629499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:56.632110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:56.655025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 526/1069] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:56.660964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.666995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd3cc-f0e9-4c01-8130-77850a55ccaa None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:56.703222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bfa80-b8b7-40fc-b9a6-81e0e5c46e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:56.703760 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bfa80-b8b7-40fc-b9a6-81e0e5c46e49 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.704255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bfa80-b8b7-40fc-b9a6-81e0e5c46e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.704255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bfa80-b8b7-40fc-b9a6-81e0e5c46e49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.713998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bfa80-b8b7-40fc-b9a6-81e0e5c46e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-c55bfa80-b8b7-40fc-b9a6-81e0e5c46e49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:23:56.719379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:56.720350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:56.721199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 544/1070] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:56.721941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe081a-6b07-4c69-a899-2b248a6f6012 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.721941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe081a-6b07-4c69-a899-2b248a6f6012 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.722570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe081a-6b07-4c69-a899-2b248a6f6012 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.723551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 545/1071] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:56.726327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe081a-6b07-4c69-a899-2b248a6f6012 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.740479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:56.760021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c0f9d-6a29-4d6b-b5e3-e140012fa6ed None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:56.792651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb56a0b-2965-44e6-9d55-59ee40eb5380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:56.793265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56a0b-2965-44e6-9d55-59ee40eb5380 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.793535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56a0b-2965-44e6-9d55-59ee40eb5380 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.793943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56a0b-2965-44e6-9d55-59ee40eb5380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.804089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb56a0b-2965-44e6-9d55-59ee40eb5380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:56.805595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb56a0b-2965-44e6-9d55-59ee40eb5380 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1cb56a0b-2965-44e6-9d55-59ee40eb5380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:56.821017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:56.822214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:56.823120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:56.823120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:56.823120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:56.823120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 527/1072] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:56.823362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896a58d-1ca2-4b99-a716-6d851a174426 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.823547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896a58d-1ca2-4b99-a716-6d851a174426 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.823800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896a58d-1ca2-4b99-a716-6d851a174426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.829631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe081a-6b07-4c69-a899-2b248a6f6012 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:56.841405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3896a58d-1ca2-4b99-a716-6d851a174426 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:56.842687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3896a58d-1ca2-4b99-a716-6d851a174426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:56.862748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:56.863348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:56.863623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:56.863880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:56.864520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:56.864813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:56.865213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:56.866511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:56.874597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 546/1073] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:23:56.875627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.914051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 528/1074] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:56.914886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896a58d-1ca2-4b99-a716-6d851a174426 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:56.957188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:56.984372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b56ad-51e5-4fcc-a786-f07e13023ac0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.019307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.019919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.020192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.020459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.020950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896a58d-1ca2-4b99-a716-6d851a174426 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.021128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:57.021385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.022803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.040040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 547/1075] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:57.041093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.061252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.061930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.062204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.062469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] PATH_INFO: `/v3/users/a0bc5def25d841158cc590b0634c5060` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.063615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] RBAC: Authorizing `identity:get_user(user_id=a0bc5def25d841158cc590b0634c5060)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.065052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.066830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 529/1076] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:23:56 2022] GET /identity/v3/users/a0bc5def25d841158cc590b0634c5060 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:57.072262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.099838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:57.146152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359fc7f-2007-4aac-a941-e7c8fd69d6e1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.179972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4d2b9-1081-4a66-8e3b-b5f5a07d8973 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.183433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.184064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.184368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.184804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.187014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:57.192849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.194590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:23:57.205662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:57.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 548/1077] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:23:57.207613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.218998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.219715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.219989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.220255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.221372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] RBAC: Authorizing `identity:get_project(project_id=4c5c7001108942869e7bde2e07a201e3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.222827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.224465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 530/1078] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:23:57 2022] GET /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:57.225202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.310371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e5b55-52b7-4cd7-bb57-d909b5960abc None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.317455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:57.324358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b36c-ec27-46df-bb78-b1bc435fdd8d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.344865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.345469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.345742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.346036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.361273 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.362041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.362590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.363290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:57.363591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.365042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.376619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 531/1079] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:57.377415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.411798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:57.420436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.421927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.476508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1efe3-6ba7-4750-ad64-0919d0f5af13 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.509069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.509714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.510022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.510288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3/users/a0bc5def25d841158cc590b0634c5060/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.512294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c5c7001108942869e7bde2e07a201e3, user_id=a0bc5def25d841158cc590b0634c5060, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.513758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.523136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 549/1080] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:23:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:23:57.524279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.530934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 532/1081] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:23:57 2022] PUT /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3/users/a0bc5def25d841158cc590b0634c5060/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:23:57.531774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.549690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:57.651978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:57.652911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4097d1-bc29-4b2f-8b5e-5131e9728277 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.660692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfe6d6-f00f-4b48-b20e-e1d9ab99fa2a None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.691649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf3e4d-5c0e-4948-9c67-5637ba30b7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.692165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3e4d-5c0e-4948-9c67-5637ba30b7eb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.692440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3e4d-5c0e-4948-9c67-5637ba30b7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.692792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3e4d-5c0e-4948-9c67-5637ba30b7eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.699768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.701167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.701444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.701716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/e45d799ba78f4adc82f3ffdc9293ff20/roles/294778c2d48046669d82ab46bd6550d5` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.703955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=e45d799ba78f4adc82f3ffdc9293ff20, role_id=294778c2d48046669d82ab46bd6550d5)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.704443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf3e4d-5c0e-4948-9c67-5637ba30b7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.705401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.705919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf3e4d-5c0e-4948-9c67-5637ba30b7eb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-fedf3e4d-5c0e-4948-9c67-5637ba30b7eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:23:57.724996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:23:57.726299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:23:57.727739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:23:57.727739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:23:57.727739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:23:57.727930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 550/1082] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:23:57 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/e45d799ba78f4adc82f3ffdc9293ff20/roles/294778c2d48046669d82ab46bd6550d5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:23:57.728010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 533/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:23:57.732615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:23:57.843084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53214af-b3d9-404d-9014-3b60b2ee420f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:23:57.880224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfb1cf-1ef0-40f1-ac88-f56e281a9a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:23:57.880859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfb1cf-1ef0-40f1-ac88-f56e281a9a21 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:57.881126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfb1cf-1ef0-40f1-ac88-f56e281a9a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:57.881390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfb1cf-1ef0-40f1-ac88-f56e281a9a21 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:57.882071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfb1cf-1ef0-40f1-ac88-f56e281a9a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:23:57.882345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfb1cf-1ef0-40f1-ac88-f56e281a9a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:23:57.883725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfb1cf-1ef0-40f1-ac88-f56e281a9a21 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:23:57.896723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 551/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:23:59.704521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6520-9d83-40ed-8f40-9bce0850c27b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:59.705124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6520-9d83-40ed-8f40-9bce0850c27b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:59.705124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6520-9d83-40ed-8f40-9bce0850c27b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:59.706439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 534/1085] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:59.711799 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6559-8586-42da-b6ce-d49d34098537 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:59.712257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6559-8586-42da-b6ce-d49d34098537 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:59.712351 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6559-8586-42da-b6ce-d49d34098537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:59.730945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-df4e6559-8586-42da-b6ce-d49d34098537 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:59.732197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-df4e6559-8586-42da-b6ce-d49d34098537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:59.741683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:23:59.804551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 552/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:23:59.884903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638f7bb-0692-41f3-8334-f01742be057d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:59.885096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638f7bb-0692-41f3-8334-f01742be057d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:59.885344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638f7bb-0692-41f3-8334-f01742be057d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:59.886718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 535/1087] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:23:59.892333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258379-27b7-4550-911a-bae4fddf524d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:23:59.892596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258379-27b7-4550-911a-bae4fddf524d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:23:59.892885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54258379-27b7-4550-911a-bae4fddf524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:23:59.911443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-54258379-27b7-4550-911a-bae4fddf524d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:23:59.913004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-54258379-27b7-4550-911a-bae4fddf524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:23:59.979474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 553/1088] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:23:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:00.067528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638f7bb-0692-41f3-8334-f01742be057d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.136870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.174590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638f7bb-0692-41f3-8334-f01742be057d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.209197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.209822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.210107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.210374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.221479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:00.226218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:00.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:00.228589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 536/1089] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:00.233835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54258379-27b7-4550-911a-bae4fddf524d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.247991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.316307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.341699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54258379-27b7-4550-911a-bae4fddf524d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.350514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc3e12-0140-4a27-b28b-0d198de221a3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.374813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.376918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.377733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.378041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.378322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.378979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:00.379284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:00.380694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:00.383741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.384364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.384637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.384901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.389147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 554/1090] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:00.395037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.395667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:00.400411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:00.401351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:00.402236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 537/1091] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:00.407749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.492645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52256-2906-40f9-a079-756b2f51b16e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.507911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8f67-e384-418c-947f-5ffcd3571567 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.526386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.527019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.527294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.527559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] PATH_INFO: `/v3/users/a0bc5def25d841158cc590b0634c5060` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.528738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] RBAC: Authorizing `identity:get_user(user_id=a0bc5def25d841158cc590b0634c5060)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:00.530183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:00.531767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 555/1092] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/users/a0bc5def25d841158cc590b0634c5060 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:00.537836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.542153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.545444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.546097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.546366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.546628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.547283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:00.548008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:00.548937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:00.557434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 538/1093] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:00.563509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.612588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.642097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52de7fd-c2d8-47a9-a7d6-2151d6d5f49e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.664522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82b7bf-3281-4b65-8c0a-d940b47bead1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.674932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.675541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.675815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.676082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.699134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416295-7390-4289-991a-7348ce6a565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.699753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416295-7390-4289-991a-7348ce6a565e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.700101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416295-7390-4289-991a-7348ce6a565e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.700373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416295-7390-4289-991a-7348ce6a565e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.710523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be416295-7390-4289-991a-7348ce6a565e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:00.711960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be416295-7390-4289-991a-7348ce6a565e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-be416295-7390-4289-991a-7348ce6a565e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:24:00.725590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:00.726853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:24:00.727761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:24:00.727761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:00.727761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:00.727761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 539/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:00.732758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416295-7390-4289-991a-7348ce6a565e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.746315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:00.747933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:00.750540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.827794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.830870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416295-7390-4289-991a-7348ce6a565e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.845524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 556/1095] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:24:00.851457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.869114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.869720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.870021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.870291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.870929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:00.871226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:00.872611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:00.884125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 540/1096] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:00.889788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:00.947386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b1a4c-c707-4dc5-a560-952f554e13bc None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.949673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:00.980060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:00.980686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:00.980959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:00.981373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:00.982537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] RBAC: Authorizing `identity:get_project(project_id=4c5c7001108942869e7bde2e07a201e3)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:00.983961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:00.985595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 557/1097] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:00.987921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fe7c6-f3c4-42ae-98a8-4ef8c5257b31 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:00.992119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:01.022687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:01.023310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:01.023579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:01.023847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:01.030912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:01.032409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:24:01.044540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:01.045642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:01.047175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 541/1098] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:01.051364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:01.072315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:01.097767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf837e-e479-4400-badf-c2f048828802 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:01.133035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:01.133949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:01.134260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:01.134531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:01.135677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=4c5c7001108942869e7bde2e07a201e3, user.id=a0bc5def25d841158cc590b0634c5060) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:01.135985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:01.137827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:01.144019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 558/1099] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:00 2022] GET /identity/v3/role_assignments?user.id=a0bc5def25d841158cc590b0634c5060&scope.project.id=4c5c7001108942869e7bde2e07a201e3&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:24:01.161438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23fe6-1694-49c1-b4de-b77053d5e676 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:01.200327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:01.200878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:01.201154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:01.201419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:01.202197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:01.202503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:01.204021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:01.225711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 542/1100] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 30 09:24:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:01.232160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:01.272287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:01.343828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585c98-32ec-4864-b7b5-28c812751d37 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:01.377932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:01.378539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:01.378808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:01.379068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:01.450584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:01.451954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:01.485714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:01.552036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 559/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:24:01.557996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:01.638839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:01.660705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc00b8a-d04a-466b-9875-a178546dd049 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:01.695156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:01.695777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:01.696044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:01.696304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:01.706624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:01.708003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:24:01.722410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:01.723834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:24:01.725548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:24:01.725548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:24:01.725548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:01.725548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 543/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:01.729304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:01.829646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c79e84-19bc-427f-992e-48121c9adba7 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:01.864395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:01.865000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:01.865256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:01.865517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:01.866175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:01.866474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:01.867841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:01.870195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:01.880446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 560/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:01.886262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:01.985703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b161-9537-42b1-8636-730bff5372f2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:02.014316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:02.020779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:02.021401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:02.021674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:02.021985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:02.028854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:02.030349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:24:02.041866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:02.042912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:02.043845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 544/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:02.049509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:02.148962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b677d8-a9a2-4cb8-a2bc-f62cfa0044e7 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:02.181342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183ae78-1a5e-47e0-8c08-61fa535c62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:02.181969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183ae78-1a5e-47e0-8c08-61fa535c62be None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:02.182215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183ae78-1a5e-47e0-8c08-61fa535c62be None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:02.182500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183ae78-1a5e-47e0-8c08-61fa535c62be None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:02.183176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183ae78-1a5e-47e0-8c08-61fa535c62be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:02.183472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183ae78-1a5e-47e0-8c08-61fa535c62be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:02.185030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183ae78-1a5e-47e0-8c08-61fa535c62be None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:02.196505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 561/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:02.202904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:02.308316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033234bb-46fb-4a71-80a6-b15c6fe08c1c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:02.342533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640da96-3e62-48d5-b54d-b3de351659c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:02.343122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640da96-3e62-48d5-b54d-b3de351659c9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:02.343392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640da96-3e62-48d5-b54d-b3de351659c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:02.343651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640da96-3e62-48d5-b54d-b3de351659c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:02.344357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640da96-3e62-48d5-b54d-b3de351659c9 None admin] RBAC: Adding query filter params (role.id=294778c2d48046669d82ab46bd6550d5, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=e45d799ba78f4adc82f3ffdc9293ff20) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:02.344654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640da96-3e62-48d5-b54d-b3de351659c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:02.346119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640da96-3e62-48d5-b54d-b3de351659c9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:02.352184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 545/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:02 2022] GET /identity/v3/role_assignments?user.id=e45d799ba78f4adc82f3ffdc9293ff20&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=294778c2d48046669d82ab46bd6550d5 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:03.323785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88bda8-59e0-4830-bc47-51a577dbd441 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:03.324682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88bda8-59e0-4830-bc47-51a577dbd441 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:03.324682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88bda8-59e0-4830-bc47-51a577dbd441 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:03.326818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 562/1107] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:03.332334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07d708-5438-432e-accd-3d0e4cbc3450 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:03.332753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07d708-5438-432e-accd-3d0e4cbc3450 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:03.332841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07d708-5438-432e-accd-3d0e4cbc3450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:03.353475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ae07d708-5438-432e-accd-3d0e4cbc3450 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:03.354702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ae07d708-5438-432e-accd-3d0e4cbc3450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:03.407966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:03.426962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 546/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:03.690675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88bda8-59e0-4830-bc47-51a577dbd441 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:03.753567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:03.806687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88bda8-59e0-4830-bc47-51a577dbd441 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:03.841390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41dd95-6269-4474-a633-97fe1c5a37fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:03.842031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41dd95-6269-4474-a633-97fe1c5a37fc None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:03.842297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41dd95-6269-4474-a633-97fe1c5a37fc None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:03.842558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41dd95-6269-4474-a633-97fe1c5a37fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:03.843693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41dd95-6269-4474-a633-97fe1c5a37fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:03.845113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41dd95-6269-4474-a633-97fe1c5a37fc None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:03.846687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 563/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:03.855280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07d708-5438-432e-accd-3d0e4cbc3450 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:03.960543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07d708-5438-432e-accd-3d0e4cbc3450 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:03.999798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797039-435d-4310-b0c0-45f4554d6ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:04.000395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797039-435d-4310-b0c0-45f4554d6ccc None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:04.000665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797039-435d-4310-b0c0-45f4554d6ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:04.000933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797039-435d-4310-b0c0-45f4554d6ccc None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:04.001588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb797039-435d-4310-b0c0-45f4554d6ccc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:04.003065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb797039-435d-4310-b0c0-45f4554d6ccc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:04.030316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 547/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:24:03 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:24:06.196881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b623-0b4f-4467-9151-36145480e3cc None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:06.197814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b623-0b4f-4467-9151-36145480e3cc None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:06.197814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b623-0b4f-4467-9151-36145480e3cc None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:06.201163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 564/1111] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:06.209349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d314aa-5c4f-43a5-8e11-bcae77039a98 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:06.210049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d314aa-5c4f-43a5-8e11-bcae77039a98 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:06.210242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d314aa-5c4f-43a5-8e11-bcae77039a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:06.237115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-76d314aa-5c4f-43a5-8e11-bcae77039a98 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:06.238329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-76d314aa-5c4f-43a5-8e11-bcae77039a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:06.278196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:06.319964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 548/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:06.591183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4b623-0b4f-4467-9151-36145480e3cc None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:06.709531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4b623-0b4f-4467-9151-36145480e3cc None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:06.732993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:06.745917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:06.746543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:06.746833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:06.747100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] PATH_INFO: `/v3/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:06.748591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] RBAC: Authorizing `identity:get_role(role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:06.749997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:06.751330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 565/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:06 2022] GET /identity/v3/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:06.757653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d314aa-5c4f-43a5-8e11-bcae77039a98 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:06.855082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d314aa-5c4f-43a5-8e11-bcae77039a98 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:06.890147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:06.890765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:06.891035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:06.891298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] PATH_INFO: `/v3/users/a84d8021729e48599ef50f04d2a1e7d2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:06.905910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] RBAC: Authorizing `identity:get_user(user_id=a84d8021729e48599ef50f04d2a1e7d2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:06.907347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:06.908941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 549/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:06 2022] GET /identity/v3/users/a84d8021729e48599ef50f04d2a1e7d2 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:06.915447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:07.023561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a359df7-7c66-4f7b-9107-eefb7c19d526 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:07.058749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:07.059388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:07.059660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:07.059925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:07.117636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:07.128788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:07.130264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:07.225021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 566/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:24:07.232144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:07.267864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:07.341754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58241ce-0bab-4a48-8b84-840ffd986b19 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:07.380065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a630e-1031-405a-9b92-05642fe16abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:07.380609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a630e-1031-405a-9b92-05642fe16abb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:07.380882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a630e-1031-405a-9b92-05642fe16abb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:07.381147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a630e-1031-405a-9b92-05642fe16abb None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:07.382404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a630e-1031-405a-9b92-05642fe16abb None admin] RBAC: Authorizing `identity:get_project(project_id=4c5c7001108942869e7bde2e07a201e3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:07.383839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a630e-1031-405a-9b92-05642fe16abb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:07.385455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 550/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:07 2022] GET /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:07.396283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:07.490201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:07.501401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776042f5-c6bd-43d3-8433-6e2ec18c434f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:07.537576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef0b78-323b-4f2c-b86f-3d0586952415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:07.538198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0b78-323b-4f2c-b86f-3d0586952415 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:07.538470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0b78-323b-4f2c-b86f-3d0586952415 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:07.538735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0b78-323b-4f2c-b86f-3d0586952415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:07.539445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef0b78-323b-4f2c-b86f-3d0586952415 None admin] RBAC: Adding query filter params (role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=4c5c7001108942869e7bde2e07a201e3, user.id=a84d8021729e48599ef50f04d2a1e7d2) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:07.539745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef0b78-323b-4f2c-b86f-3d0586952415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:07.541170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef0b78-323b-4f2c-b86f-3d0586952415 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:07.546526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 567/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:07 2022] GET /identity/v3/role_assignments?user.id=a84d8021729e48599ef50f04d2a1e7d2&scope.project.id=4c5c7001108942869e7bde2e07a201e3&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:09.663403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e9b9-d0f1-4fdd-8078-1cce2dcc937b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:09.664220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e9b9-d0f1-4fdd-8078-1cce2dcc937b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:09.664220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e9b9-d0f1-4fdd-8078-1cce2dcc937b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:09.666520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 551/1118] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:09.672801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b200e6-d2a2-4f29-aec9-4d0315e8c526 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:09.673261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b200e6-d2a2-4f29-aec9-4d0315e8c526 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:09.673361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b200e6-d2a2-4f29-aec9-4d0315e8c526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:09.696010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-56b200e6-d2a2-4f29-aec9-4d0315e8c526 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:09.697187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-56b200e6-d2a2-4f29-aec9-4d0315e8c526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:09.771599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 568/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:10.040021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e9b9-d0f1-4fdd-8078-1cce2dcc937b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:10.143172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:10.152421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e9b9-d0f1-4fdd-8078-1cce2dcc937b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:10.189664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:10.190319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:10.190593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:10.190857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] PATH_INFO: `/v3/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:10.192406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] RBAC: Authorizing `identity:get_role(role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:10.193828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:10.195166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 552/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:10 2022] GET /identity/v3/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:10.202174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b200e6-d2a2-4f29-aec9-4d0315e8c526 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:10.296405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:10.312732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b200e6-d2a2-4f29-aec9-4d0315e8c526 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:10.348783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:10.349420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:10.349690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:10.349983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] PATH_INFO: `/v3/users/a84d8021729e48599ef50f04d2a1e7d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:10.351313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] RBAC: Authorizing `identity:get_user(user_id=a84d8021729e48599ef50f04d2a1e7d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:10.352758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:10.354383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 569/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:10 2022] GET /identity/v3/users/a84d8021729e48599ef50f04d2a1e7d2 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:10.360602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:10.488640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536cfe-5bf6-4fdb-9b74-a424bc48a82c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:10.525143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205ba7f-8136-46bc-a990-143da6728a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:10.525749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ba7f-8136-46bc-a990-143da6728a82 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:10.526050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ba7f-8136-46bc-a990-143da6728a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:10.526311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ba7f-8136-46bc-a990-143da6728a82 None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:10.527489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205ba7f-8136-46bc-a990-143da6728a82 None admin] RBAC: Authorizing `identity:get_project(project_id=4c5c7001108942869e7bde2e07a201e3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:10.529105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205ba7f-8136-46bc-a990-143da6728a82 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:10.530761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 553/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:10 2022] GET /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:10.538101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:10.647142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a5b86-03d0-4075-abba-918fd3a0771b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:10.691402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28723b09-846a-48a3-80b5-90b1b7e54040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:10.692060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723b09-846a-48a3-80b5-90b1b7e54040 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:10.692325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723b09-846a-48a3-80b5-90b1b7e54040 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:10.692591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723b09-846a-48a3-80b5-90b1b7e54040 None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3/users/a84d8021729e48599ef50f04d2a1e7d2/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:10.695114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28723b09-846a-48a3-80b5-90b1b7e54040 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c5c7001108942869e7bde2e07a201e3, user_id=a84d8021729e48599ef50f04d2a1e7d2, role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:10.696549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28723b09-846a-48a3-80b5-90b1b7e54040 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:10.712156 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 570/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:10 2022] PUT /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3/users/a84d8021729e48599ef50f04d2a1e7d2/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:24:12.800129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7dc30-4ee7-4927-92d3-cb0f888b70d0 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:12.800688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7dc30-4ee7-4927-92d3-cb0f888b70d0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:12.800688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7dc30-4ee7-4927-92d3-cb0f888b70d0 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:12.802027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 554/1124] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:12.808349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666c077-3672-458e-99b8-9e0d357ef3f5 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:12.809096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666c077-3672-458e-99b8-9e0d357ef3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:12.809228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666c077-3672-458e-99b8-9e0d357ef3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:12.834662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e666c077-3672-458e-99b8-9e0d357ef3f5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:12.835856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e666c077-3672-458e-99b8-9e0d357ef3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:12.848983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:12.915468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 571/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:13.180374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7dc30-4ee7-4927-92d3-cb0f888b70d0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:13.219565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:13.295123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7dc30-4ee7-4927-92d3-cb0f888b70d0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:13.329976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:13.330577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:13.330851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:13.331115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] PATH_INFO: `/v3/roles/821020e5f9a0461ba795b0ac6428aba9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:13.332608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] RBAC: Authorizing `identity:get_role(role_id=821020e5f9a0461ba795b0ac6428aba9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:13.334009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:13.335342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 555/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:13 2022] GET /identity/v3/roles/821020e5f9a0461ba795b0ac6428aba9 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:13.341822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666c077-3672-458e-99b8-9e0d357ef3f5 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:13.448751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666c077-3672-458e-99b8-9e0d357ef3f5 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:13.486016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:13.486640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:13.486910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:13.487173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] PATH_INFO: `/v3/users/a84d8021729e48599ef50f04d2a1e7d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:13.488342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] RBAC: Authorizing `identity:get_user(user_id=a84d8021729e48599ef50f04d2a1e7d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:13.489782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:13.491377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 572/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:13 2022] GET /identity/v3/users/a84d8021729e48599ef50f04d2a1e7d2 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:13.497584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:13.598638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:13.601944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626d2b-e246-4d27-b12f-508f41949824 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:13.639265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:13.639865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:13.640134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:13.640399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:13.711725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:13.713997 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:13.818518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:13.822830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 556/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:24:13.829723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:13.850029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:13.950188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f913e4e-2ade-4ee1-be74-9bc9c182281c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:13.988838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760decd-4e1d-42fd-8315-6cfb3e8c1420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:13.989660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760decd-4e1d-42fd-8315-6cfb3e8c1420 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:13.990147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760decd-4e1d-42fd-8315-6cfb3e8c1420 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:13.990552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760decd-4e1d-42fd-8315-6cfb3e8c1420 None admin] PATH_INFO: `/v3/projects/4c5c7001108942869e7bde2e07a201e3` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:13.992566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760decd-4e1d-42fd-8315-6cfb3e8c1420 None admin] RBAC: Authorizing `identity:get_project(project_id=4c5c7001108942869e7bde2e07a201e3)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:13.994865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760decd-4e1d-42fd-8315-6cfb3e8c1420 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:13.997279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 573/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:13 2022] GET /identity/v3/projects/4c5c7001108942869e7bde2e07a201e3 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:14.004187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:14.115615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6196-eb8f-476f-8cf3-158ffdbf5846 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:14.151413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5ad94-c14d-4e68-8b52-5f6ec4355b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:14.151994 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ad94-c14d-4e68-8b52-5f6ec4355b43 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:14.152263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ad94-c14d-4e68-8b52-5f6ec4355b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:14.152527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ad94-c14d-4e68-8b52-5f6ec4355b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:14.153381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5ad94-c14d-4e68-8b52-5f6ec4355b43 None admin] RBAC: Adding query filter params (role.id=821020e5f9a0461ba795b0ac6428aba9, scope.project.id=4c5c7001108942869e7bde2e07a201e3, user.id=a84d8021729e48599ef50f04d2a1e7d2) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:14.153775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5ad94-c14d-4e68-8b52-5f6ec4355b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:14.155224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5ad94-c14d-4e68-8b52-5f6ec4355b43 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:14.161087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 557/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:14 2022] GET /identity/v3/role_assignments?user.id=a84d8021729e48599ef50f04d2a1e7d2&scope.project.id=4c5c7001108942869e7bde2e07a201e3&role.id=821020e5f9a0461ba795b0ac6428aba9 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:16.314905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202be21-5729-4e6f-be2f-85bff3ea73b0 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:16.315507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202be21-5729-4e6f-be2f-85bff3ea73b0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:16.315507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202be21-5729-4e6f-be2f-85bff3ea73b0 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:16.316774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 574/1131] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:16.323209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f751b-f7f6-4774-babd-26232af0ed28 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:16.323664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f751b-f7f6-4774-babd-26232af0ed28 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:16.323763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f751b-f7f6-4774-babd-26232af0ed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:16.349630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-df8f751b-f7f6-4774-babd-26232af0ed28 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:16.350859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-df8f751b-f7f6-4774-babd-26232af0ed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:16.414690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:16.423679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 558/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:16.688787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202be21-5729-4e6f-be2f-85bff3ea73b0 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:16.777097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:16.804186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202be21-5729-4e6f-be2f-85bff3ea73b0 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:16.839137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3059d-8c4c-4470-a293-d201a37631ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:16.839757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3059d-8c4c-4470-a293-d201a37631ca None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:16.840026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3059d-8c4c-4470-a293-d201a37631ca None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:16.840370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3059d-8c4c-4470-a293-d201a37631ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:16.841495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3059d-8c4c-4470-a293-d201a37631ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:16.842941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3059d-8c4c-4470-a293-d201a37631ca None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:16.844505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 575/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:16.850927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f751b-f7f6-4774-babd-26232af0ed28 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:16.956437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f751b-f7f6-4774-babd-26232af0ed28 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:16.991483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871320e-76f9-4f1b-be1d-822e685e3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:16.992074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871320e-76f9-4f1b-be1d-822e685e3033 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:16.992341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871320e-76f9-4f1b-be1d-822e685e3033 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:16.992609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871320e-76f9-4f1b-be1d-822e685e3033 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:16.993246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871320e-76f9-4f1b-be1d-822e685e3033 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:16.994715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871320e-76f9-4f1b-be1d-822e685e3033 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:17.024262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 559/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:24:16 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:19.218934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1a9d2-5c36-4dbf-8bfc-dc2ba543ab18 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:19.219599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1a9d2-5c36-4dbf-8bfc-dc2ba543ab18 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:19.219599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1a9d2-5c36-4dbf-8bfc-dc2ba543ab18 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:19.220807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 576/1135] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:19.228423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d27691-c9c7-4dcb-813b-706ebf5be15d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:19.229150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d27691-c9c7-4dcb-813b-706ebf5be15d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:19.229279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d27691-c9c7-4dcb-813b-706ebf5be15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:19.255178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b1d27691-c9c7-4dcb-813b-706ebf5be15d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:19.256382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b1d27691-c9c7-4dcb-813b-706ebf5be15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:19.303150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:19.332779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 560/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:19.600444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1a9d2-5c36-4dbf-8bfc-dc2ba543ab18 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:19.713180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1a9d2-5c36-4dbf-8bfc-dc2ba543ab18 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:19.750422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa4555-8f2e-4e4c-92d3-b8c9ced9f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:19.751047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4555-8f2e-4e4c-92d3-b8c9ced9f98d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:19.751322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4555-8f2e-4e4c-92d3-b8c9ced9f98d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:19.751590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4555-8f2e-4e4c-92d3-b8c9ced9f98d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:19.752881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa4555-8f2e-4e4c-92d3-b8c9ced9f98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:19.754364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa4555-8f2e-4e4c-92d3-b8c9ced9f98d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:19.755953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 577/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:19.764815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d27691-c9c7-4dcb-813b-706ebf5be15d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:19.873621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d27691-c9c7-4dcb-813b-706ebf5be15d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:19.912507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aea432-48b2-4616-a404-e245d87eb0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:19.913098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aea432-48b2-4616-a404-e245d87eb0c1 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:19.913370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aea432-48b2-4616-a404-e245d87eb0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:19.913631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aea432-48b2-4616-a404-e245d87eb0c1 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:19.914300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aea432-48b2-4616-a404-e245d87eb0c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:19.915743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aea432-48b2-4616-a404-e245d87eb0c1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:19.940336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 561/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:24:19 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:22.114997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bec72c-bbdc-4f8c-8ff1-4acded77a5e0 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:22.115900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bec72c-bbdc-4f8c-8ff1-4acded77a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:22.115900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bec72c-bbdc-4f8c-8ff1-4acded77a5e0 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:22.118002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 578/1139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:22.125143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae54f-aaeb-4a40-9824-995841ade66d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:22.125537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae54f-aaeb-4a40-9824-995841ade66d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:22.125673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae54f-aaeb-4a40-9824-995841ade66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:22.144712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-145ae54f-aaeb-4a40-9824-995841ade66d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:22.145933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-145ae54f-aaeb-4a40-9824-995841ade66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:22.173809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:22.220426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 562/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:22.484948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bec72c-bbdc-4f8c-8ff1-4acded77a5e0 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:22.519257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:22.616091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bec72c-bbdc-4f8c-8ff1-4acded77a5e0 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:22.654029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:22.654650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:22.654921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:22.655181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:22.666669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:22.671440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:22.672503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:24:22.673553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 579/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:22.679712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae54f-aaeb-4a40-9824-995841ade66d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:22.788789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae54f-aaeb-4a40-9824-995841ade66d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:22.826964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:22.827566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:22.827841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:22.828123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:22.828786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:22.829086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:22.830456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:22.841069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 563/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:22.847564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:22.927332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:22.953775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e211e9-ad70-42d0-a3ab-400acbe925f7 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:22.989146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:22.989756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:22.990061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:22.990329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] PATH_INFO: `/v3/users/31d2bc3ba2b8476f86adb93f2b28fa3f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:23.003891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] RBAC: Authorizing `identity:get_user(user_id=31d2bc3ba2b8476f86adb93f2b28fa3f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:23.005331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:23.006951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 580/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:22 2022] GET /identity/v3/users/31d2bc3ba2b8476f86adb93f2b28fa3f => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:23.013255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:23.042161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:23.121098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f33cf-66bc-4045-aa1b-6cabcd68cc43 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:23.158760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:23.159356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:23.159606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:23.159868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:23.235759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:23.237208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:23.261768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:23.337772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 564/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:24:23.343950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:23.449571 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999c98-9a0e-4707-ace1-e58c2186a92c None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:23.483992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91137d86-6a90-48e1-bc95-89f571ae40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:23.484600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91137d86-6a90-48e1-bc95-89f571ae40c4 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:23.484867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91137d86-6a90-48e1-bc95-89f571ae40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:23.485126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91137d86-6a90-48e1-bc95-89f571ae40c4 None admin] PATH_INFO: `/v3/projects/1a5a4323816043db8f94b68bde69c1b2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:23.486377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91137d86-6a90-48e1-bc95-89f571ae40c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a5a4323816043db8f94b68bde69c1b2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:23.487792 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91137d86-6a90-48e1-bc95-89f571ae40c4 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:23.489393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 581/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:23 2022] GET /identity/v3/projects/1a5a4323816043db8f94b68bde69c1b2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:23.499081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:23.615002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5405-a498-4817-8429-5e0745846c06 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:23.639023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:23.650578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50d804-82a4-4f13-b999-60594b99c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:23.651191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d804-82a4-4f13-b999-60594b99c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:23.651461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d804-82a4-4f13-b999-60594b99c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:23.651741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d804-82a4-4f13-b999-60594b99c4d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:23.652475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50d804-82a4-4f13-b999-60594b99c4d3 None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=1a5a4323816043db8f94b68bde69c1b2, user.id=31d2bc3ba2b8476f86adb93f2b28fa3f) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:23.652949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50d804-82a4-4f13-b999-60594b99c4d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:23.654481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50d804-82a4-4f13-b999-60594b99c4d3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:23.659991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 565/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:23 2022] GET /identity/v3/role_assignments?user.id=31d2bc3ba2b8476f86adb93f2b28fa3f&scope.project.id=1a5a4323816043db8f94b68bde69c1b2&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:25.783848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0322-bbfe-4e88-96bf-70d649d288de None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:25.784406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0322-bbfe-4e88-96bf-70d649d288de None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:25.784406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0322-bbfe-4e88-96bf-70d649d288de None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:25.785722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 582/1147] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:24:25.792457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22132b7-3e37-4fcf-8b64-4991b438ea1c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:25.793248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22132b7-3e37-4fcf-8b64-4991b438ea1c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:25.793857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22132b7-3e37-4fcf-8b64-4991b438ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:25.814294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e22132b7-3e37-4fcf-8b64-4991b438ea1c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:25.815473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e22132b7-3e37-4fcf-8b64-4991b438ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:25.884178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 566/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:26.159383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0322-bbfe-4e88-96bf-70d649d288de None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:26.163048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:26.271993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0322-bbfe-4e88-96bf-70d649d288de None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:26.307130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:26.307749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:26.308019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:26.308281 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:26.318959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:26.323706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:26.325027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:24:26.325935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 583/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:26.331256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22132b7-3e37-4fcf-8b64-4991b438ea1c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:26.438032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22132b7-3e37-4fcf-8b64-4991b438ea1c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:26.460343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:26.478165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:26.478757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:26.479025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:26.479286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:26.479932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:26.480227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:26.481650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:26.489753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 567/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:26.498811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:26.568348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:26.609043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e239-10f2-45be-840e-fc1adb91cc34 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:26.648448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:26.649327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:26.649674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:26.650009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] PATH_INFO: `/v3/users/31d2bc3ba2b8476f86adb93f2b28fa3f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:26.651996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] RBAC: Authorizing `identity:get_user(user_id=31d2bc3ba2b8476f86adb93f2b28fa3f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:26.653755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:26.655381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 584/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:26 2022] GET /identity/v3/users/31d2bc3ba2b8476f86adb93f2b28fa3f => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:26.661500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:26.767435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9640fd-c414-462f-9f5b-f7c0b3a0f057 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:26.802448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65a44b-5f6f-4333-8493-7e907df28d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:26.803052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a44b-5f6f-4333-8493-7e907df28d20 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:26.803309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a44b-5f6f-4333-8493-7e907df28d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:26.803572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a44b-5f6f-4333-8493-7e907df28d20 None admin] PATH_INFO: `/v3/projects/1a5a4323816043db8f94b68bde69c1b2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:26.804791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65a44b-5f6f-4333-8493-7e907df28d20 None admin] RBAC: Authorizing `identity:get_project(project_id=1a5a4323816043db8f94b68bde69c1b2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:26.806251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65a44b-5f6f-4333-8493-7e907df28d20 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:26.807846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 568/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:26 2022] GET /identity/v3/projects/1a5a4323816043db8f94b68bde69c1b2 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:26.817541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:26.932373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165636b-332b-4b20-85a9-96b2b30846c2 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:26.962271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:26.969108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc4d6-5fd9-47db-8306-6d77a9c31019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:26.969757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc4d6-5fd9-47db-8306-6d77a9c31019 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:26.970051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc4d6-5fd9-47db-8306-6d77a9c31019 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:26.970326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc4d6-5fd9-47db-8306-6d77a9c31019 None admin] PATH_INFO: `/v3/projects/1a5a4323816043db8f94b68bde69c1b2/users/31d2bc3ba2b8476f86adb93f2b28fa3f/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:26.972228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bc4d6-5fd9-47db-8306-6d77a9c31019 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a5a4323816043db8f94b68bde69c1b2, user_id=31d2bc3ba2b8476f86adb93f2b28fa3f, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:26.973653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bc4d6-5fd9-47db-8306-6d77a9c31019 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:26.988361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 585/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:26 2022] PUT /identity/v3/projects/1a5a4323816043db8f94b68bde69c1b2/users/31d2bc3ba2b8476f86adb93f2b28fa3f/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:24:29.089482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12230db7-377c-4006-9f68-ba5dd76d836b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:29.090472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12230db7-377c-4006-9f68-ba5dd76d836b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:29.090634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12230db7-377c-4006-9f68-ba5dd76d836b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:29.092710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 569/1154] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:29.102106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94802-c594-473f-b93f-927e0204a839 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:29.102838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94802-c594-473f-b93f-927e0204a839 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:29.103051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94802-c594-473f-b93f-927e0204a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:29.128757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-fdc94802-c594-473f-b93f-927e0204a839 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:29.129973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fdc94802-c594-473f-b93f-927e0204a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:29.205904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 586/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:29.474943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12230db7-377c-4006-9f68-ba5dd76d836b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:29.540638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:29.601955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12230db7-377c-4006-9f68-ba5dd76d836b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:29.638253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:29.638888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:29.639157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:29.639420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:29.650611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:29.655406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:29.656554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:29.657562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 570/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:29.664923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc94802-c594-473f-b93f-927e0204a839 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:29.769365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc94802-c594-473f-b93f-927e0204a839 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:29.790175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:29.806290 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:29.806889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:29.807158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:29.807420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:29.808068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:29.808359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:29.809925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:29.817784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 587/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:29.823871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:29.925546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd4103-d30b-4559-9d46-c7750c1c3d2a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:29.936410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:29.964387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:29.965065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:29.965336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:29.965594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] PATH_INFO: `/v3/users/31d2bc3ba2b8476f86adb93f2b28fa3f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:29.966802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] RBAC: Authorizing `identity:get_user(user_id=31d2bc3ba2b8476f86adb93f2b28fa3f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:29.968246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:29.969819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 571/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:29 2022] GET /identity/v3/users/31d2bc3ba2b8476f86adb93f2b28fa3f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:29.976007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.073307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbeeba-37f4-459f-a0e1-e0e226ad9020 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:30.107808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:30.108413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.108646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.108904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.160349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:30.182556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:30.184073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:30.285684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 588/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:24:30.292256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.408901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7815-aeb0-4d88-90a1-3f4f7d6ce90f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:30.445649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a856c78-30d9-49b4-b0c2-20c5df984fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:30.446285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a856c78-30d9-49b4-b0c2-20c5df984fbb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.446557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a856c78-30d9-49b4-b0c2-20c5df984fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.446822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a856c78-30d9-49b4-b0c2-20c5df984fbb None admin] PATH_INFO: `/v3/projects/1a5a4323816043db8f94b68bde69c1b2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.448069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a856c78-30d9-49b4-b0c2-20c5df984fbb None admin] RBAC: Authorizing `identity:get_project(project_id=1a5a4323816043db8f94b68bde69c1b2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:30.449628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a856c78-30d9-49b4-b0c2-20c5df984fbb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:30.451293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 572/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/projects/1a5a4323816043db8f94b68bde69c1b2 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:30.457672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:30.552425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:30.575185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc650abe-6cf5-4c6a-9997-e5383b6b6b1d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:30.612160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544076a4-8d80-4788-8993-bda7b2b6858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:30.612747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544076a4-8d80-4788-8993-bda7b2b6858c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:30.613014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544076a4-8d80-4788-8993-bda7b2b6858c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:30.613275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544076a4-8d80-4788-8993-bda7b2b6858c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:30.614013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544076a4-8d80-4788-8993-bda7b2b6858c None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=1a5a4323816043db8f94b68bde69c1b2, user.id=31d2bc3ba2b8476f86adb93f2b28fa3f) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:30.614313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544076a4-8d80-4788-8993-bda7b2b6858c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:30.615736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544076a4-8d80-4788-8993-bda7b2b6858c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:30.621936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 589/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:30 2022] GET /identity/v3/role_assignments?user.id=31d2bc3ba2b8476f86adb93f2b28fa3f&scope.project.id=1a5a4323816043db8f94b68bde69c1b2&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:32.753736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da513da-d199-4990-b942-7a6bd9dce27f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:32.754332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da513da-d199-4990-b942-7a6bd9dce27f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:32.754332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da513da-d199-4990-b942-7a6bd9dce27f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:32.756336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 573/1162] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:32.765206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd54bb-3797-44b6-92de-e82a86e4d34d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:32.765618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd54bb-3797-44b6-92de-e82a86e4d34d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:32.765783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd54bb-3797-44b6-92de-e82a86e4d34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:32.790389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-aabd54bb-3797-44b6-92de-e82a86e4d34d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:32.791579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-aabd54bb-3797-44b6-92de-e82a86e4d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:32.864556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 590/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:33.129275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da513da-d199-4990-b942-7a6bd9dce27f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:33.183153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:33.241743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da513da-d199-4990-b942-7a6bd9dce27f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:33.280526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:33.281114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:33.281384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:33.281647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:33.353690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:33.355156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:33.410631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:33.469189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 574/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:24:33.475470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd54bb-3797-44b6-92de-e82a86e4d34d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:33.553310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:33.576774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd54bb-3797-44b6-92de-e82a86e4d34d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:33.610848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a159b9-1f9d-409e-aa38-79c762107f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:33.611468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a159b9-1f9d-409e-aa38-79c762107f5e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:33.611740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a159b9-1f9d-409e-aa38-79c762107f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:33.611991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a159b9-1f9d-409e-aa38-79c762107f5e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:33.619432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a159b9-1f9d-409e-aa38-79c762107f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:33.620927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a159b9-1f9d-409e-aa38-79c762107f5e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-60a159b9-1f9d-409e-aa38-79c762107f5e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:33.635602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:33.637208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:24:33.638386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 591/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:24:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:33.642936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:33.758109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47e6f6-fe9e-4ce1-8e69-d049d96fae2d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:33.798386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84edf6-aef9-4bc9-9e90-16e373457592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:33.798989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84edf6-aef9-4bc9-9e90-16e373457592 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:33.799259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84edf6-aef9-4bc9-9e90-16e373457592 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:33.799521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84edf6-aef9-4bc9-9e90-16e373457592 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:33.800153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84edf6-aef9-4bc9-9e90-16e373457592 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:33.800478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84edf6-aef9-4bc9-9e90-16e373457592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:33.801859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84edf6-aef9-4bc9-9e90-16e373457592 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:33.809599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 575/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 30 09:24:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:35.938069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab11c-f803-48e0-97d9-20147b3cf5b2 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.938623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab11c-f803-48e0-97d9-20147b3cf5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.938623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab11c-f803-48e0-97d9-20147b3cf5b2 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.939869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 592/1167] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:35.946485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea9dc-741b-47c8-8e1e-f6664e7f0104 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:35.946926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea9dc-741b-47c8-8e1e-f6664e7f0104 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:35.947146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea9dc-741b-47c8-8e1e-f6664e7f0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:35.968001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d83ea9dc-741b-47c8-8e1e-f6664e7f0104 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:35.969172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d83ea9dc-741b-47c8-8e1e-f6664e7f0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:35.971193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:36.054697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 576/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:36.330203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ab11c-f803-48e0-97d9-20147b3cf5b2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:36.442861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ab11c-f803-48e0-97d9-20147b3cf5b2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:36.477182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d19122-d543-4c50-9f9d-3109fd7aff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:36.477765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19122-d543-4c50-9f9d-3109fd7aff5d None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:36.478061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19122-d543-4c50-9f9d-3109fd7aff5d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:36.478324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19122-d543-4c50-9f9d-3109fd7aff5d None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:36.484705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d19122-d543-4c50-9f9d-3109fd7aff5d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:36.484705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d19122-d543-4c50-9f9d-3109fd7aff5d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:36.485626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:36.502433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 593/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Fri Sep 30 09:24:36 2022] POST /identity/v3/domains => generated 267 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:38.658601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea996fd-1394-4846-9652-737391686c8a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.659438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea996fd-1394-4846-9652-737391686c8a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.659438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea996fd-1394-4846-9652-737391686c8a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.662026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 577/1170] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:38.671011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5f47-f03c-4b34-808f-863a0105f089 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:38.671447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5f47-f03c-4b34-808f-863a0105f089 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:38.671573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5f47-f03c-4b34-808f-863a0105f089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:38.696175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ca5d5f47-f03c-4b34-808f-863a0105f089 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:38.697369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ca5d5f47-f03c-4b34-808f-863a0105f089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:38.770059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 594/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:39.034343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea996fd-1394-4846-9652-737391686c8a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:39.156628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea996fd-1394-4846-9652-737391686c8a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:39.197460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94906422-3e7e-4865-9331-5ccd50c69e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:39.198109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906422-3e7e-4865-9331-5ccd50c69e15 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:39.198385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906422-3e7e-4865-9331-5ccd50c69e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:39.198649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906422-3e7e-4865-9331-5ccd50c69e15 None admin] PATH_INFO: `/v3/domains/aa92857bbafd4253a48248bab2599a4e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:39.205626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:39.210037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94906422-3e7e-4865-9331-5ccd50c69e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aa92857bbafd4253a48248bab2599a4e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:39.211498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94906422-3e7e-4865-9331-5ccd50c69e15 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:39.213130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 578/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Sep 30 09:24:39 2022] GET /identity/v3/domains/aa92857bbafd4253a48248bab2599a4e => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:39.219187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5f47-f03c-4b34-808f-863a0105f089 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:39.330447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5f47-f03c-4b34-808f-863a0105f089 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:39.355745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:39.365028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9046df-0fa3-4ad1-8c76-ce7244049501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:39.365630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9046df-0fa3-4ad1-8c76-ce7244049501 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:39.365924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9046df-0fa3-4ad1-8c76-ce7244049501 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:39.366185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9046df-0fa3-4ad1-8c76-ce7244049501 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:39.366815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9046df-0fa3-4ad1-8c76-ce7244049501 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:39.368224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9046df-0fa3-4ad1-8c76-ce7244049501 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:39.401823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 595/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:24:39 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:24:41.569833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928f634-ec21-4529-b7ee-f0ef132e0712 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:41.570708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928f634-ec21-4529-b7ee-f0ef132e0712 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:41.570708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928f634-ec21-4529-b7ee-f0ef132e0712 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:41.572852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 579/1174] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:41.578369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cda068-4628-4bfc-b98e-affcfa8b3993 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:41.578811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cda068-4628-4bfc-b98e-affcfa8b3993 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:41.578911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cda068-4628-4bfc-b98e-affcfa8b3993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:41.598493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-88cda068-4628-4bfc-b98e-affcfa8b3993 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:41.599668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-88cda068-4628-4bfc-b98e-affcfa8b3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:41.667866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 596/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:41.938502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928f634-ec21-4529-b7ee-f0ef132e0712 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:42.040809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928f634-ec21-4529-b7ee-f0ef132e0712 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:42.075525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2ba89-2f5a-4053-886d-5e568f9cebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:42.076159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba89-2f5a-4053-886d-5e568f9cebb9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:42.076438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba89-2f5a-4053-886d-5e568f9cebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:42.076692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba89-2f5a-4053-886d-5e568f9cebb9 None admin] PATH_INFO: `/v3/domains/aa92857bbafd4253a48248bab2599a4e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:42.077824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ba89-2f5a-4053-886d-5e568f9cebb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aa92857bbafd4253a48248bab2599a4e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:42.079250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ba89-2f5a-4053-886d-5e568f9cebb9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:42.080852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 580/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Sep 30 09:24:41 2022] GET /identity/v3/domains/aa92857bbafd4253a48248bab2599a4e => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:42.088679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cda068-4628-4bfc-b98e-affcfa8b3993 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:42.189143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cda068-4628-4bfc-b98e-affcfa8b3993 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:42.197990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:42.224912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea08579-551a-4c32-bacb-8a93f4a52720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:42.225512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea08579-551a-4c32-bacb-8a93f4a52720 None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:42.225761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea08579-551a-4c32-bacb-8a93f4a52720 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:42.226058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea08579-551a-4c32-bacb-8a93f4a52720 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:42.226705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea08579-551a-4c32-bacb-8a93f4a52720 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:42.228116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea08579-551a-4c32-bacb-8a93f4a52720 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:42.252214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 597/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:24:42 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:24:44.430152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49400893-6fec-4404-8773-be1d7a870be2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:44.430749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49400893-6fec-4404-8773-be1d7a870be2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:44.430749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49400893-6fec-4404-8773-be1d7a870be2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:44.432017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 581/1178] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:44.438504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13a06-c62a-4633-9dab-71607f4f5d76 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:44.439232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13a06-c62a-4633-9dab-71607f4f5d76 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:44.439384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13a06-c62a-4633-9dab-71607f4f5d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:44.464926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-34d13a06-c62a-4633-9dab-71607f4f5d76 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:44.466212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-34d13a06-c62a-4633-9dab-71607f4f5d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:44.533091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 598/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:44.798630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49400893-6fec-4404-8773-be1d7a870be2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:44.878052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:44.923712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49400893-6fec-4404-8773-be1d7a870be2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:44.960223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:44.960833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:44.961104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:44.961372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:44.973379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:44.978158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:44.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:44.980517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 582/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:44.985693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13a06-c62a-4633-9dab-71607f4f5d76 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:45.083952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:45.091613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13a06-c62a-4633-9dab-71607f4f5d76 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:45.126166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:45.126765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.127034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.127299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.127950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:45.128250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:45.129617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:45.137891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 599/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:45.144518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:45.273380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66cbfe-8d11-4bb6-8517-bd75914cc604 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:45.303122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:45.313026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:45.313651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.313953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.314223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] PATH_INFO: `/v3/users/26b8ffbcf7034abda0aa3485d1876f12` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.327949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] RBAC: Authorizing `identity:get_user(user_id=26b8ffbcf7034abda0aa3485d1876f12)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:45.329404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:45.331129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 583/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:45 2022] GET /identity/v3/users/26b8ffbcf7034abda0aa3485d1876f12 => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:45.337392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:45.439204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dc96b-1122-4123-a830-44c90808a6dd None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:45.473686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:45.474312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.474585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.474855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.500229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:45.543216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:45.544640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:45.647684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 600/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:24:45.654453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:45.763989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49226b3-6f23-4990-98d8-7b0dc229e42f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:45.798901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e4b0-b7d1-4533-8932-bc92a77bc0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:45.799505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e4b0-b7d1-4533-8932-bc92a77bc0ca None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.799770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e4b0-b7d1-4533-8932-bc92a77bc0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.800032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e4b0-b7d1-4533-8932-bc92a77bc0ca None admin] PATH_INFO: `/v3/projects/1140147394334a458a7ff48eada6a673` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.801267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e4b0-b7d1-4533-8932-bc92a77bc0ca None admin] RBAC: Authorizing `identity:get_project(project_id=1140147394334a458a7ff48eada6a673)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:45.802720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e4b0-b7d1-4533-8932-bc92a77bc0ca None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:45.804313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 584/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:45 2022] GET /identity/v3/projects/1140147394334a458a7ff48eada6a673 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:45.814049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:45.878028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:45.920255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac788-95f5-49ad-a713-9f718a5a9b0f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:45.954658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5af94-125d-4792-a383-cd739713012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:45.955255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5af94-125d-4792-a383-cd739713012b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:45.955525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5af94-125d-4792-a383-cd739713012b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:45.955791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5af94-125d-4792-a383-cd739713012b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:45.956504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5af94-125d-4792-a383-cd739713012b None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=1140147394334a458a7ff48eada6a673, user.id=26b8ffbcf7034abda0aa3485d1876f12) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:45.956803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5af94-125d-4792-a383-cd739713012b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:45.958256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5af94-125d-4792-a383-cd739713012b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:45.963444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 601/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:45 2022] GET /identity/v3/role_assignments?user.id=26b8ffbcf7034abda0aa3485d1876f12&scope.project.id=1140147394334a458a7ff48eada6a673&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:48.116101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a798-2c22-4858-8845-a496336cdd06 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.116980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a798-2c22-4858-8845-a496336cdd06 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.116980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a798-2c22-4858-8845-a496336cdd06 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.119299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 585/1186] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:48.126354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930318-00da-482d-9a93-48a8b277acc3 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.127069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930318-00da-482d-9a93-48a8b277acc3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.127206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930318-00da-482d-9a93-48a8b277acc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.149575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d9930318-00da-482d-9a93-48a8b277acc3 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:48.150827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d9930318-00da-482d-9a93-48a8b277acc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:48.227284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 602/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:48.491147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a798-2c22-4858-8845-a496336cdd06 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.551682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:48.602688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a798-2c22-4858-8845-a496336cdd06 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.638417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.639035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.639306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.639576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.650261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:48.655054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:48.656119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:24:48.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 586/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:48.663395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9930318-00da-482d-9a93-48a8b277acc3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.731338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:48.786924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9930318-00da-482d-9a93-48a8b277acc3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.833248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:48.833837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:48.834137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:48.834400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:48.835051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:48.835339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:48.836703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:48.844802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 603/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:48.851098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:48.963185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c529a-9b11-4729-b05d-bdfb04db5dde None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:48.977912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:49.003494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:49.004115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:49.004387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:49.004650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] PATH_INFO: `/v3/users/26b8ffbcf7034abda0aa3485d1876f12` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:49.005944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] RBAC: Authorizing `identity:get_user(user_id=26b8ffbcf7034abda0aa3485d1876f12)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:49.007397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:49.008975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 587/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:48 2022] GET /identity/v3/users/26b8ffbcf7034abda0aa3485d1876f12 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:49.015228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:49.119522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ab8a-7c1d-4150-8395-2e738c22613e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:49.133493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:49.159396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd150-4454-48e7-aee5-121cf18b1a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:49.160014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd150-4454-48e7-aee5-121cf18b1a36 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:49.160282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd150-4454-48e7-aee5-121cf18b1a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:49.160545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd150-4454-48e7-aee5-121cf18b1a36 None admin] PATH_INFO: `/v3/projects/1140147394334a458a7ff48eada6a673` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:49.162109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd150-4454-48e7-aee5-121cf18b1a36 None admin] RBAC: Authorizing `identity:get_project(project_id=1140147394334a458a7ff48eada6a673)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:49.163517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd150-4454-48e7-aee5-121cf18b1a36 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:49.165138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 604/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:49 2022] GET /identity/v3/projects/1140147394334a458a7ff48eada6a673 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:49.171422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:49.282394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54412a-9df8-4569-a2b7-fd65936c30f4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:49.318872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf339-2937-4bef-aa9a-bee92ac83205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:49.319506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf339-2937-4bef-aa9a-bee92ac83205 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:49.319775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf339-2937-4bef-aa9a-bee92ac83205 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:49.320038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf339-2937-4bef-aa9a-bee92ac83205 None admin] PATH_INFO: `/v3/projects/1140147394334a458a7ff48eada6a673/users/26b8ffbcf7034abda0aa3485d1876f12/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:49.322036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf339-2937-4bef-aa9a-bee92ac83205 None admin] RBAC: Authorizing `identity:create_grant(project_id=1140147394334a458a7ff48eada6a673, user_id=26b8ffbcf7034abda0aa3485d1876f12, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:49.323468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf339-2937-4bef-aa9a-bee92ac83205 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:49.338888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 588/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:24:49 2022] PUT /identity/v3/projects/1140147394334a458a7ff48eada6a673/users/26b8ffbcf7034abda0aa3485d1876f12/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:24:51.449679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a4e7-43d4-41e8-82cb-41b16064f127 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.450296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a4e7-43d4-41e8-82cb-41b16064f127 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.450296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a4e7-43d4-41e8-82cb-41b16064f127 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.451587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 605/1193] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:24:51.458125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b05d3-3d00-4a81-9252-8c410c65044d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.458835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b05d3-3d00-4a81-9252-8c410c65044d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.458983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b05d3-3d00-4a81-9252-8c410c65044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.481721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fe8b05d3-3d00-4a81-9252-8c410c65044d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:24:51.482926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fe8b05d3-3d00-4a81-9252-8c410c65044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:24:51.519494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:51.556104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 589/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:24:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:24:51.827089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a4e7-43d4-41e8-82cb-41b16064f127 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:51.933809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a4e7-43d4-41e8-82cb-41b16064f127 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:51.968379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:51.968994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:51.969258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:51.969522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:51.981025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:24:51.985738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:24:51.986818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:24:51.987916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 606/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:24:51.993648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b05d3-3d00-4a81-9252-8c410c65044d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.105241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b05d3-3d00-4a81-9252-8c410c65044d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.147942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.148776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.149131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.149486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.150509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:52.150882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.152716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.161634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 590/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.167785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.209739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.273835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2e489-6487-477a-b2b2-45fa8e979714 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.308901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.309517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.309786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.310044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] PATH_INFO: `/v3/users/26b8ffbcf7034abda0aa3485d1876f12` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.311232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] RBAC: Authorizing `identity:get_user(user_id=26b8ffbcf7034abda0aa3485d1876f12)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.312661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.314284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 607/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/users/26b8ffbcf7034abda0aa3485d1876f12 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.320471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.357569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.440574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94214ec3-4632-46e1-aecf-7a14aa3f5479 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.474407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.475017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.475287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.475545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.548949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.550442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.581691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.662093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 591/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:24:52.668459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.768975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce598-f623-4068-ae4b-81fe79121993 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.777856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.804691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3815569-0ace-41d8-8a8f-99b569809a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.805316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815569-0ace-41d8-8a8f-99b569809a13 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.805591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815569-0ace-41d8-8a8f-99b569809a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.805889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815569-0ace-41d8-8a8f-99b569809a13 None admin] PATH_INFO: `/v3/projects/1140147394334a458a7ff48eada6a673` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.807054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3815569-0ace-41d8-8a8f-99b569809a13 None admin] RBAC: Authorizing `identity:get_project(project_id=1140147394334a458a7ff48eada6a673)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.808598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3815569-0ace-41d8-8a8f-99b569809a13 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.810263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 608/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/projects/1140147394334a458a7ff48eada6a673 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:24:52.816796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:24:52.935152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d83ba-44d6-4ea6-b3b0-3aaed06ceb6e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:24:52.964789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:24:52.971435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd313a-8906-4407-b67a-34ff5e37eecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:24:52.972032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd313a-8906-4407-b67a-34ff5e37eecd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:24:52.972300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd313a-8906-4407-b67a-34ff5e37eecd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:24:52.972557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd313a-8906-4407-b67a-34ff5e37eecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:24:52.973267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd313a-8906-4407-b67a-34ff5e37eecd None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=1140147394334a458a7ff48eada6a673, user.id=26b8ffbcf7034abda0aa3485d1876f12) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:24:52.973562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd313a-8906-4407-b67a-34ff5e37eecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:24:52.975020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd313a-8906-4407-b67a-34ff5e37eecd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:24:52.981158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 592/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:24:52 2022] GET /identity/v3/role_assignments?user.id=26b8ffbcf7034abda0aa3485d1876f12&scope.project.id=1140147394334a458a7ff48eada6a673&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:02.799608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:02.978283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.129382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa51a9-86ef-451e-8fc3-7185e3f55b53 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.130038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa51a9-86ef-451e-8fc3-7185e3f55b53 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.130038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa51a9-86ef-451e-8fc3-7185e3f55b53 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.131736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 609/1201] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:49.138332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391161e8-c59c-434e-9df3-b09db04c0e1e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.138845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391161e8-c59c-434e-9df3-b09db04c0e1e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.138845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391161e8-c59c-434e-9df3-b09db04c0e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.164455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-391161e8-c59c-434e-9df3-b09db04c0e1e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:49.165961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-391161e8-c59c-434e-9df3-b09db04c0e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:49.258664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 593/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:25:49.563460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa51a9-86ef-451e-8fc3-7185e3f55b53 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.686639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa51a9-86ef-451e-8fc3-7185e3f55b53 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.727136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.728179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.728467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.728733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.740850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.742465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:49.758056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:49.759509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:49.760528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:49.760528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:49.760528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:25:49.760528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 610/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:49.766381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391161e8-c59c-434e-9df3-b09db04c0e1e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:49.902795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391161e8-c59c-434e-9df3-b09db04c0e1e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:49.933218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:49.939450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c185-1b99-45c2-ac0b-cf4ee63eb9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:49.940277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c185-1b99-45c2-ac0b-cf4ee63eb9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:49.940644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c185-1b99-45c2-ac0b-cf4ee63eb9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:49.940916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c185-1b99-45c2-ac0b-cf4ee63eb9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:49.941555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c185-1b99-45c2-ac0b-cf4ee63eb9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:49.941882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c185-1b99-45c2-ac0b-cf4ee63eb9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:49.943612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c185-1b99-45c2-ac0b-cf4ee63eb9b6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:49.960400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 594/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:49.961965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:50.025774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:50.089494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aec25-a970-4bde-a89f-6f3c36ba3d8b None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:50.134863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c4d7d-cf74-4eca-ac7a-bddb6736eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:50.135532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d7d-cf74-4eca-ac7a-bddb6736eedd None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:50.135752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d7d-cf74-4eca-ac7a-bddb6736eedd None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:50.136130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d7d-cf74-4eca-ac7a-bddb6736eedd None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:50.136932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c4d7d-cf74-4eca-ac7a-bddb6736eedd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:50.138558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c4d7d-cf74-4eca-ac7a-bddb6736eedd None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:50.167245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 611/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 30 09:25:49 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:25:52.586101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c389-d043-4b38-998d-3ec427d14fc7 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.586712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c389-d043-4b38-998d-3ec427d14fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.586712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c389-d043-4b38-998d-3ec427d14fc7 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.588623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 595/1206] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:52.594675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e050d-06d8-4274-a3ef-59d70b5ec328 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:52.598781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e050d-06d8-4274-a3ef-59d70b5ec328 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:52.598781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e050d-06d8-4274-a3ef-59d70b5ec328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:52.620308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-bf2e050d-06d8-4274-a3ef-59d70b5ec328 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:52.621553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-bf2e050d-06d8-4274-a3ef-59d70b5ec328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:52.698045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 612/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:25:52.998184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862c389-d043-4b38-998d-3ec427d14fc7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.125531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862c389-d043-4b38-998d-3ec427d14fc7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.171304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.171927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.172204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.172473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.184579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:53.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:53.190406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:53.191269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 596/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:53.198834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e050d-06d8-4274-a3ef-59d70b5ec328 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.243868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.311889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e050d-06d8-4274-a3ef-59d70b5ec328 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.348628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.349896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.349896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.349896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.350524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:53.350827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.352363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.362731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 613/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:53.376928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.445685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.502656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c3750-7c9a-4905-8766-e4d7e897ca86 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.543608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.544306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.544621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.544903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.560207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.561970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:53.580000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:53.581234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:53.586884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:53.586884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:53.586884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:53.586884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 597/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:53.589060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.707016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.710547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a0de-5e9d-4cf1-826a-b85340cf843d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.749554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.750207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.750478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.750777 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.751390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:53.751706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.753049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.765452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 614/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:53.771654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:53.885544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3824-23a4-4f4b-95dd-f667447f6863 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:53.885544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:53.928380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:53.929013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.929281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.929611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.938827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:53.940446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:53.953360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:53.954597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:53.955706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 598/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:53.961477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.078083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb713e-86a3-44f6-b950-252c9f2322e8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.116716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50847a-df6f-4624-a086-beae728caeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.117356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50847a-df6f-4624-a086-beae728caeba None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.117632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50847a-df6f-4624-a086-beae728caeba None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.118484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50847a-df6f-4624-a086-beae728caeba None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.119313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50847a-df6f-4624-a086-beae728caeba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:54.119712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50847a-df6f-4624-a086-beae728caeba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.121245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50847a-df6f-4624-a086-beae728caeba None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.140908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 615/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:54.146560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.259316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63765a47-8303-47fe-8b96-845f2e4ce278 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.299082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.299694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.299953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.300208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.333142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.374224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.375710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.486752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 599/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:25:54.493057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50847a-df6f-4624-a086-beae728caeba None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.514401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.605950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50847a-df6f-4624-a086-beae728caeba None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.643940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.644533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.644877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.645150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.656149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.657787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:54.676426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:54.677734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:54.678734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:54.678734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:54.678734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:25:54.678734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 616/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:54.683780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.752389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.805105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cc8c-2a6b-42e3-83ff-49b3937097c5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:54.847164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:54.847769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:54.848033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:54.848295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:54.848930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:54.849221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:54.850661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:54.862615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 600/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:54.868953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:54.944622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:54.980041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b68f6-2333-42c0-b1cb-e7e3e3120aa6 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.016614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.017141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.017460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.017871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.026260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.027864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:55.041617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:55.043773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:25:55.045997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 617/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:55.051021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.154240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344609c-8660-4991-9740-7d0ad29a5fea None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.179092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.192916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfa84c-2a99-4457-8dba-dd89467762da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.193524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfa84c-2a99-4457-8dba-dd89467762da None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.193821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfa84c-2a99-4457-8dba-dd89467762da None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.194154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfa84c-2a99-4457-8dba-dd89467762da None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.194840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfa84c-2a99-4457-8dba-dd89467762da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.195139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfa84c-2a99-4457-8dba-dd89467762da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.196912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfa84c-2a99-4457-8dba-dd89467762da None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.209662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 601/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:55.216120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:55.335206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02728-73a9-48dc-ac87-ce7ecce052d1 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:55.367617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:55.374456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee3559-68c5-45c3-93bb-0e4de27ba57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:55.375115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3559-68c5-45c3-93bb-0e4de27ba57e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:55.375529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3559-68c5-45c3-93bb-0e4de27ba57e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:55.375833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3559-68c5-45c3-93bb-0e4de27ba57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:55.376811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee3559-68c5-45c3-93bb-0e4de27ba57e None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=d7777f87a39a47999af1bfda0b3883d2) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:55.377329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee3559-68c5-45c3-93bb-0e4de27ba57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:55.379009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee3559-68c5-45c3-93bb-0e4de27ba57e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:55.386608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 618/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:25:55 2022] GET /identity/v3/role_assignments?user.id=d7777f87a39a47999af1bfda0b3883d2&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:57.767190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bcef5-ec0c-47c1-93ec-0677e734817d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.767785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bcef5-ec0c-47c1-93ec-0677e734817d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.767785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bcef5-ec0c-47c1-93ec-0677e734817d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.769299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 602/1220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:25:57.774929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f6f20-7194-4155-83d0-f2d78c552775 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:57.775373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f6f20-7194-4155-83d0-f2d78c552775 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:57.775473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f6f20-7194-4155-83d0-f2d78c552775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:57.795532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-223f6f20-7194-4155-83d0-f2d78c552775 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:25:57.796726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-223f6f20-7194-4155-83d0-f2d78c552775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:25:57.865030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 619/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:25:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:25:58.126447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bcef5-ec0c-47c1-93ec-0677e734817d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.241055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bcef5-ec0c-47c1-93ec-0677e734817d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.277085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.277686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.277980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.278515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.289540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:25:58.295335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:58.297391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:58.299956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 603/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:58.304874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f6f20-7194-4155-83d0-f2d78c552775 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.420796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f6f20-7194-4155-83d0-f2d78c552775 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.448342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:58.460652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.461298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.461638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.462003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.462705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:58.463007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:58.464373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:58.472608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 620/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:25:58.478961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.526087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:58.588826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa278e-9028-434e-ad2a-298b0ecb3a6a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.628895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.629679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.629871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.630110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.640973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:58.643068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:58.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:58.662051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:58.663466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:58.663466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:58.663466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:58.663466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 604/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:58.667911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.782938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e12df-7731-4f20-a7a8-4e43a65f90e0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.817259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.817894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.818170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.818435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.819067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:58.819364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:58.820869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:58.834412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 621/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:58.840611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:58.939936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:58.947588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edc1d3-234d-4232-ac88-9839dc883bf2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:58.982364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:58.982987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:58.983261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:58.983592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:58.991372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:58.993334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:25:59.005523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:59.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:59.007833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 605/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:59.012851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.064061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.118844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db629561-bbaf-458c-bd54-4bdc8f324966 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.154063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.154698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.154966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.155227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.155968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:59.156265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.157674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.175222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 622/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:59.182033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.293085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8430ea-ffec-4d45-b52b-e449e9646e64 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.331209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.331758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.332029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.332296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.344425 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.346042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:25:59.361306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:59.362480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:25:59.363436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:25:59.363436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:25:59.363436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:59.363436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 606/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:59.368675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.473417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d84b5-4ed4-4e8f-a5e7-093350965205 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.475855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.514461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.515183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.515491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.515778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.516418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:59.516731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.518087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.530161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 623/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:59.536404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.545943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.643997 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7556-3830-4f05-b0fb-2061b003895f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.681350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.682159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.682547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.682912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.689809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.691362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:25:59.702911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:25:59.704041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:25:59.705128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 607/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:25:59.710432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.826102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ada419-f924-4b07-a96d-c0c53d83a4f0 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:25:59.859993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc1589-981c-4d57-a031-34066f30083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:25:59.860656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc1589-981c-4d57-a031-34066f30083c None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:59.860880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc1589-981c-4d57-a031-34066f30083c None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:59.861145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc1589-981c-4d57-a031-34066f30083c None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:59.861858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc1589-981c-4d57-a031-34066f30083c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:25:59.862158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc1589-981c-4d57-a031-34066f30083c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:25:59.863587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc1589-981c-4d57-a031-34066f30083c None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:25:59.877994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 624/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:25:59.884347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:25:59.961947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:25:59.998508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038b95-65ee-4841-969f-9ee28d5332fc None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:00.040736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529623e1-d6dc-4bd6-a1fd-fc48a6fff681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:00.041571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529623e1-d6dc-4bd6-a1fd-fc48a6fff681 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.041961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529623e1-d6dc-4bd6-a1fd-fc48a6fff681 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.042372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529623e1-d6dc-4bd6-a1fd-fc48a6fff681 None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/d7777f87a39a47999af1bfda0b3883d2/roles/d7d221ea917b4de09e35c98f4ecc0b9e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.059593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529623e1-d6dc-4bd6-a1fd-fc48a6fff681 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=d7777f87a39a47999af1bfda0b3883d2, role_id=d7d221ea917b4de09e35c98f4ecc0b9e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:00.061397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529623e1-d6dc-4bd6-a1fd-fc48a6fff681 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:00.077094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 608/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:25:59 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/d7777f87a39a47999af1bfda0b3883d2/roles/d7d221ea917b4de09e35c98f4ecc0b9e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:02.464744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735112af-6d0e-4055-a635-6bd44bcc0424 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.465426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735112af-6d0e-4055-a635-6bd44bcc0424 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.465426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735112af-6d0e-4055-a635-6bd44bcc0424 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.466632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 625/1233] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:02.472772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f810-4040-4ba1-934e-5d481b100c42 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:02.473364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f810-4040-4ba1-934e-5d481b100c42 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:02.473464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f810-4040-4ba1-934e-5d481b100c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:02.494661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9746f810-4040-4ba1-934e-5d481b100c42 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:02.495855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9746f810-4040-4ba1-934e-5d481b100c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:02.573618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 609/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:02.873924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735112af-6d0e-4055-a635-6bd44bcc0424 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:02.901702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:02.992486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735112af-6d0e-4055-a635-6bd44bcc0424 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.033167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.033932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.034639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.034991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.048882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:03.054004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:03.058049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:03.059054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 626/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 30 09:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:03.062049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f810-4040-4ba1-934e-5d481b100c42 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.111327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.167126 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f810-4040-4ba1-934e-5d481b100c42 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.203312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.203976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.204316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.204621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.205365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.205682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.207107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.215495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 610/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.221622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.317538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.337873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f1680-cad7-470b-a16b-f97d8dfedeed None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.379960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.380599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.380866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.381125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.392870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.394396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:03.411031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:03.412270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:03.413192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:03.413192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:03.413192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:03.413192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 627/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:03.418970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.531308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4706a-03f2-4ad5-b41b-c587a0573fea None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.541821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.570892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.571347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.571554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.571822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.572500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.572804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.574340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.587445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 611/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.593980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.704732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3706c-a224-48e3-8166-a10391897730 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.738963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.739660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.739981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.740264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.743469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:03.749012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.750830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:03.762895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:03.764027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:03.765542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 628/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:03.770734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:03.876557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e94-fef8-4d28-be4c-ca4120effaed None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:03.911072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:03.911675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.911947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.912209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.912926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:03.913225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:03.915006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:03.932533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 612/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.938626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.046556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510de5-003b-4e69-b290-4aac51554727 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.082431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.083112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.083392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.083663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.150277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.158456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.160433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.263195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 629/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:04.269400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.297970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.400544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700e796-9329-4e6d-bdde-972218c37165 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.440094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.440716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.441060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.441289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.452384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.453931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:04.468934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:04.474000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:04.475171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:04.475171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:04.475171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:04.475171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 613/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:04.477706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.578665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.585512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da320-078d-47ad-a5cd-27db4cd9c745 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.626176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.626833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.627107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.627372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.628015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:04.628313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.629726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.643934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 630/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:04.650152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.736621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:04.759692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bfba4-b90f-4920-9931-638a8ba05b3f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.797223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.797893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.798170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.798436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.805875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.807351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:04.820101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:04.821386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:04.822453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 614/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:04.827730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.943907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b04e-0f3f-4c98-a356-97c31c5d09ae None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.984823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838d638-a999-45a2-ae0e-decdf9ca8772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.985617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838d638-a999-45a2-ae0e-decdf9ca8772 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.985955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838d638-a999-45a2-ae0e-decdf9ca8772 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.986223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838d638-a999-45a2-ae0e-decdf9ca8772 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.986908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838d638-a999-45a2-ae0e-decdf9ca8772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:04.987287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838d638-a999-45a2-ae0e-decdf9ca8772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.988830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838d638-a999-45a2-ae0e-decdf9ca8772 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.001774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 631/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:05.008184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:05.127912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd4c0-c34c-4214-9860-7c3ca5e40c50 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:05.169893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df2c0a-57e8-4563-b7e8-db308b3b4b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:05.170588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2c0a-57e8-4563-b7e8-db308b3b4b7b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:05.170844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2c0a-57e8-4563-b7e8-db308b3b4b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:05.171154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2c0a-57e8-4563-b7e8-db308b3b4b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:05.171962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df2c0a-57e8-4563-b7e8-db308b3b4b7b None admin] RBAC: Adding query filter params (role.id=d7d221ea917b4de09e35c98f4ecc0b9e, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=d7777f87a39a47999af1bfda0b3883d2) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:05.172347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df2c0a-57e8-4563-b7e8-db308b3b4b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:05.174053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df2c0a-57e8-4563-b7e8-db308b3b4b7b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:05.181210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 615/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:05 2022] GET /identity/v3/role_assignments?user.id=d7777f87a39a47999af1bfda0b3883d2&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=d7d221ea917b4de09e35c98f4ecc0b9e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:07.452788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a183544-d936-482a-8198-4e72bba9a10c None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.453488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a183544-d936-482a-8198-4e72bba9a10c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.453488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a183544-d936-482a-8198-4e72bba9a10c None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.454716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 632/1247] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:07.461810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1da685-d51c-47d0-92d2-c616e013c85d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.462496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1da685-d51c-47d0-92d2-c616e013c85d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.462656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1da685-d51c-47d0-92d2-c616e013c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.470329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.486216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1b1da685-d51c-47d0-92d2-c616e013c85d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:07.487550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1b1da685-d51c-47d0-92d2-c616e013c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:07.559495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 616/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:07.822658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a183544-d936-482a-8198-4e72bba9a10c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.840284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.933769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a183544-d936-482a-8198-4e72bba9a10c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.981778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.982608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.983049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.983324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.995970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:08.001859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:08.003083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:08.010580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 633/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:08.011432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1da685-d51c-47d0-92d2-c616e013c85d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.119865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1da685-d51c-47d0-92d2-c616e013c85d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.151360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.156750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.157393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.157734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.158033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.158743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:08.159064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.160911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.169786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 617/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:08.176014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.260618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.291590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb740b75-03dc-4e6c-8e42-518c8c792b22 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.332925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.333700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.334056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.334404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.347803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.349434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:08.364607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:08.365813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:08.366921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:08.366921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:08.366921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:08.366921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 634/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:08.372021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.488349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d8386-f9cf-44c7-b7ad-c6da0a28baab None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.529241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.529981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.530261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.530662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.531268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:08.531559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.532934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.548809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 618/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:08.554797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.669139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e9d3b-f018-4dc1-a7f3-c110805c10a9 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.695589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.704931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.705778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.706086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.706364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.720274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.722072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:08.735752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:08.736895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:08.738069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 635/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:08.744056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:08.803937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:08.854085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90199b7-7ee3-4f3e-9ecc-667c4cbc4bdc None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:08.888520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:08.889128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:08.889404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:08.889672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:08.890435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:08.890738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:08.892295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:08.910308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 619/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:08.916704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.037442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51584-a940-4922-b86c-39812d49a346 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.074434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.075232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.075412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.075627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.132818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:09.156084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.157819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.268069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 636/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:26:09.274539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.415215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834012-9a8a-4d9b-a518-564fc887e39d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.431099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:09.453097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.453744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.454042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.454303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.465564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.467050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:09.482494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:09.483703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:09.484820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:09.484820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:09.484820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:09.484820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 620/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:09.489828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.582046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:09.597589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d84a-930a-4c7b-a1b8-e3edc35a4f61 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.635044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.635663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.635934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.636189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.636831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:09.637129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.638533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.651401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 637/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:09.657473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.766797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b265446-4fe9-457a-8812-4f7ef6e7198f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.802657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.803292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.803567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.803817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.810893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.812366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:09.823664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:09.824577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:09.825712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 621/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:09.830859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:09.933317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab595b1-2252-47cb-9a88-34f800fc4cc6 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:09.967827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c659a6-5bcb-4c0c-8db4-8ef23c0f4505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:09.968434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c659a6-5bcb-4c0c-8db4-8ef23c0f4505 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:09.968702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c659a6-5bcb-4c0c-8db4-8ef23c0f4505 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:09.968967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c659a6-5bcb-4c0c-8db4-8ef23c0f4505 None admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:09.969638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c659a6-5bcb-4c0c-8db4-8ef23c0f4505 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:09.969965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c659a6-5bcb-4c0c-8db4-8ef23c0f4505 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:09.971390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c659a6-5bcb-4c0c-8db4-8ef23c0f4505 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:09.983949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 638/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:09.990328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:10.017198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:10.097400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83783320-4f50-4858-bac3-fe43bd7ad60b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:10.132697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93afa86-f4dd-46f5-b7ef-966ba046b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:10.133481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93afa86-f4dd-46f5-b7ef-966ba046b12b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.133752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93afa86-f4dd-46f5-b7ef-966ba046b12b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.134123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93afa86-f4dd-46f5-b7ef-966ba046b12b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.134833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93afa86-f4dd-46f5-b7ef-966ba046b12b None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=d7777f87a39a47999af1bfda0b3883d2) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:10.135133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93afa86-f4dd-46f5-b7ef-966ba046b12b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:10.136564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93afa86-f4dd-46f5-b7ef-966ba046b12b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:10.141926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 622/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:09 2022] GET /identity/v3/role_assignments?user.id=d7777f87a39a47999af1bfda0b3883d2&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:12.225372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f0bc-b80a-45dc-86bd-05c85858f481 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.225978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f0bc-b80a-45dc-86bd-05c85858f481 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.225978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f0bc-b80a-45dc-86bd-05c85858f481 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.227542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 639/1261] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:12.233059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c951-ff94-4387-be8b-a3d790ea83c5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.233451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c951-ff94-4387-be8b-a3d790ea83c5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.233593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3c951-ff94-4387-be8b-a3d790ea83c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.254269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bfc3c951-ff94-4387-be8b-a3d790ea83c5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:12.255476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bfc3c951-ff94-4387-be8b-a3d790ea83c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:12.338714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 623/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:12.606447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518f0bc-b80a-45dc-86bd-05c85858f481 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.620481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.724599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518f0bc-b80a-45dc-86bd-05c85858f481 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.760172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.760803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.761160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.761437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.771807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:12.777102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:12.778204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:12.779435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 640/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:12.785014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3c951-ff94-4387-be8b-a3d790ea83c5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.804127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.890779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3c951-ff94-4387-be8b-a3d790ea83c5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.927268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.927857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.928132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.928393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.929047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:12.929389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.931245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.939428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 624/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:12.946156 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.031249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.076878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca22b5-a3f0-4574-aa2d-06af9aa21107 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.115994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.116613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.116885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.117148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.129830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.131319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:13.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:13.148270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:13.149487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:13.149487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:13.149487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:13.153404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 641/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:13.154526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.242673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.263697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808ea6-6fbd-40b4-9f22-6e7961eff512 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.306356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.307168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.307686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.308300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.309120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:13.309678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.311723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.330290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 625/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:13.336420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.440940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60903a-93bd-401f-9c54-fb183f26e2d3 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.460342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.475545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.476157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.476437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.476700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.484396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.485821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:13.496831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:13.497917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:13.498921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 642/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:13.504056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.621585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9235c4-87ea-4ac9-af91-c1172b220c1a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.657853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.658479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.658755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.659376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.660102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:13.660403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.661836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.670642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:13.679172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 626/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:13.685836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.790223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50c79d-8abb-4090-88f1-7d610ec9985d None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.826118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.826725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.827001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.827271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.838182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.839622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:13.854645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:13.855691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:13.856784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:13.856784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:13.856784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:13.856784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 643/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:13.861756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:13.967590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c5ccc-5029-4834-9305-9842c67d943d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.013126 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb886-ba50-4657-b471-00cec92098de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.014032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb886-ba50-4657-b471-00cec92098de None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.014451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb886-ba50-4657-b471-00cec92098de None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.014871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb886-ba50-4657-b471-00cec92098de None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.015857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efb886-ba50-4657-b471-00cec92098de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:14.016317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efb886-ba50-4657-b471-00cec92098de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.018549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efb886-ba50-4657-b471-00cec92098de None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.032644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 627/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:14.039060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.073572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.142244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794bd44-1ad5-4919-b2c9-6f89b1687b4f None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.177265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.178201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.178468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.185382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.186853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:14.198617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:14.199623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:14.200713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 644/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:14.205845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb886-ba50-4657-b471-00cec92098de None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.269488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.319440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb886-ba50-4657-b471-00cec92098de None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.355511 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9feb8-b5b4-4fff-8dc8-a84b23808099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.356039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9feb8-b5b4-4fff-8dc8-a84b23808099 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.356310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9feb8-b5b4-4fff-8dc8-a84b23808099 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.356578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9feb8-b5b4-4fff-8dc8-a84b23808099 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.357261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9feb8-b5b4-4fff-8dc8-a84b23808099 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:14.357565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9feb8-b5b4-4fff-8dc8-a84b23808099 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.359083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9feb8-b5b4-4fff-8dc8-a84b23808099 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.373868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 628/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:14.380339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.477618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.492154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c2eb-b8fc-431a-a276-f7b0f7167c19 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.526282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d52f51-95f5-4ef3-a6d1-40edc60dd8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.526925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52f51-95f5-4ef3-a6d1-40edc60dd8b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.527193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52f51-95f5-4ef3-a6d1-40edc60dd8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.527458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52f51-95f5-4ef3-a6d1-40edc60dd8b2 None admin] PATH_INFO: `/v3/projects/fb57050b93a6408e991b5898992d6de9/users/d7777f87a39a47999af1bfda0b3883d2/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.529582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d52f51-95f5-4ef3-a6d1-40edc60dd8b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb57050b93a6408e991b5898992d6de9, user_id=d7777f87a39a47999af1bfda0b3883d2, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:14.531072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d52f51-95f5-4ef3-a6d1-40edc60dd8b2 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:14.548272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 645/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:14 2022] PUT /identity/v3/projects/fb57050b93a6408e991b5898992d6de9/users/d7777f87a39a47999af1bfda0b3883d2/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:16.660514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21af741-9897-4ab6-bc32-4e0ee294eadd None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.661059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21af741-9897-4ab6-bc32-4e0ee294eadd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.661059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21af741-9897-4ab6-bc32-4e0ee294eadd None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.662535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 629/1274] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:16.668487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff0f2d-4e7b-47e5-9181-b411bce8cd86 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:16.668904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff0f2d-4e7b-47e5-9181-b411bce8cd86 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:16.669026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff0f2d-4e7b-47e5-9181-b411bce8cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:16.689604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-cfff0f2d-4e7b-47e5-9181-b411bce8cd86 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:16.690823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-cfff0f2d-4e7b-47e5-9181-b411bce8cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:16.759626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 646/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:17.023569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21af741-9897-4ab6-bc32-4e0ee294eadd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.153981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21af741-9897-4ab6-bc32-4e0ee294eadd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.171933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.190061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.190666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.190936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.191202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.201550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:17.206360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:17.207348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:17.208638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 630/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:17.213726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff0f2d-4e7b-47e5-9181-b411bce8cd86 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.296986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.322061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff0f2d-4e7b-47e5-9181-b411bce8cd86 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.365268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.366122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.366570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.367009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.367912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:17.368736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.370534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.379473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 647/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:17.386233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.490529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd568c-d609-4819-a81e-54bc4c9732c0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.525533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.526391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.526837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.527102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.537562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.539053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:17.553810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:17.554935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:17.556057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:17.556057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:17.556057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:17.556057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 631/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:17.561019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.673562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e029-4b35-4ee2-9eaa-98ddadc7b825 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.708064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.708661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.708932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.709181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.709832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:17.710132 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.711487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.722823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 648/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:17.729056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.762757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:17.842346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ae931-c3b8-4a7b-9640-a0d17cf07c5e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:17.878079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:17.878680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:17.878949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:17.879208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:17.887729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:17.889169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:26:17.907962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:17.909448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:17.910565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 632/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:17.916970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:17.920906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.016433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96970-014e-45e3-89e2-c5ce720d319e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.051388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.051980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.052247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.052513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.053216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:18.053518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.054961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.071957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 649/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 30 09:26:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:18.081264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.180094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.191756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f5c97-804f-4484-8567-9fd7c838e33c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.228597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.229177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.229450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.229713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.298081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.299594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.392340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.403538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 633/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:26:18.410584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.486522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.533063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24048e-e84d-4fb8-8808-495e03ea32f8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.576140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.576764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.577038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.577302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.588962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.590438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:18.605725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:18.606841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:18.607786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:18.607786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:18.607786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:18.607786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 650/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:18.614843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.733469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff583a-ffbc-4e05-aee0-a77fb208e2ed None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.768475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.768990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.769262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.769522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.770177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:18.770473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.771834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.783016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 634/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:18.790251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.897495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125d5ba-8dee-4dd4-b378-ca50f7a73e15 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.912564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.936297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.936915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.937188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.937453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.944494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.945972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:26:18.957858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:18.958938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: ERROR keystone.server.flask.application Sep 30 09:26:18.960369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 651/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:18.967882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.031176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:19.095741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e95f-092d-4f5d-aff8-760236d101af None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.131525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b8e7b-b00a-4b40-a6d9-69c4ce365fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.132089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8e7b-b00a-4b40-a6d9-69c4ce365fdd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.132358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8e7b-b00a-4b40-a6d9-69c4ce365fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.132620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8e7b-b00a-4b40-a6d9-69c4ce365fdd None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.133308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b8e7b-b00a-4b40-a6d9-69c4ce365fdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:19.133601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b8e7b-b00a-4b40-a6d9-69c4ce365fdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.135064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b8e7b-b00a-4b40-a6d9-69c4ce365fdd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.148048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 635/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:19.155108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:19.255714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9041a55-bb7e-475f-bfd5-241a39bf775e None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:19.290601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc4bc3-ba48-4f08-b18c-15708da0f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:19.291168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc4bc3-ba48-4f08-b18c-15708da0f87a None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:19.291439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc4bc3-ba48-4f08-b18c-15708da0f87a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:19.291705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc4bc3-ba48-4f08-b18c-15708da0f87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:19.292420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc4bc3-ba48-4f08-b18c-15708da0f87a None admin] RBAC: Adding query filter params (role.id=1348b8ebea08426882910c6e9c3b6e78, scope.project.id=fb57050b93a6408e991b5898992d6de9, user.id=d7777f87a39a47999af1bfda0b3883d2) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:19.292723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc4bc3-ba48-4f08-b18c-15708da0f87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:19.294176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc4bc3-ba48-4f08-b18c-15708da0f87a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:19.299999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 652/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:19 2022] GET /identity/v3/role_assignments?user.id=d7777f87a39a47999af1bfda0b3883d2&scope.project.id=fb57050b93a6408e991b5898992d6de9&role.id=1348b8ebea08426882910c6e9c3b6e78 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:21.514831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffdfcf-77d9-4958-a2b7-0e98fca86e06 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.515699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffdfcf-77d9-4958-a2b7-0e98fca86e06 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.515699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffdfcf-77d9-4958-a2b7-0e98fca86e06 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.517743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 636/1288] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:21.526160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362eb1b-b26a-434c-9fec-d60d51514cae None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.526591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362eb1b-b26a-434c-9fec-d60d51514cae None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.526863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362eb1b-b26a-434c-9fec-d60d51514cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.547691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5362eb1b-b26a-434c-9fec-d60d51514cae None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:21.548886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5362eb1b-b26a-434c-9fec-d60d51514cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:21.587015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:21.625383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 653/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:21.895098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffdfcf-77d9-4958-a2b7-0e98fca86e06 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.016037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffdfcf-77d9-4958-a2b7-0e98fca86e06 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.027384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.054048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.054658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.054926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.055186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.055750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.057224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:22.066077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:22.067254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:22.068295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 637/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:22.075366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362eb1b-b26a-434c-9fec-d60d51514cae None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.177410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362eb1b-b26a-434c-9fec-d60d51514cae None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.225910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8f09-df08-4cd1-a5b0-55336bfa217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.226511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8f09-df08-4cd1-a5b0-55336bfa217f None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.226783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8f09-df08-4cd1-a5b0-55336bfa217f None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.227043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8f09-df08-4cd1-a5b0-55336bfa217f None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.227661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8f09-df08-4cd1-a5b0-55336bfa217f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:22.227954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8f09-df08-4cd1-a5b0-55336bfa217f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.229308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8f09-df08-4cd1-a5b0-55336bfa217f None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.234347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 654/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:22.243675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.366803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0d764-ec47-4d37-aad4-35733f39177b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.403861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904cd49-579d-4095-955b-b0341bcc06b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.404455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904cd49-579d-4095-955b-b0341bcc06b0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.404728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904cd49-579d-4095-955b-b0341bcc06b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.404986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904cd49-579d-4095-955b-b0341bcc06b0 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.405606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904cd49-579d-4095-955b-b0341bcc06b0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:22.405937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904cd49-579d-4095-955b-b0341bcc06b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.407306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904cd49-579d-4095-955b-b0341bcc06b0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.412339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 638/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:24.531748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63534-b5ad-4316-9651-c61c80645c83 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.532306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63534-b5ad-4316-9651-c61c80645c83 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.532306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63534-b5ad-4316-9651-c61c80645c83 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.534737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 655/1293] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:24.542734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f584459-3361-4574-9747-32caabc1b9dd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.543211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f584459-3361-4574-9747-32caabc1b9dd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.543304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f584459-3361-4574-9747-32caabc1b9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.562665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5f584459-3361-4574-9747-32caabc1b9dd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:24.563847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5f584459-3361-4574-9747-32caabc1b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:24.596674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.639744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 639/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:26:24.902509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63534-b5ad-4316-9651-c61c80645c83 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.936516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.011829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63534-b5ad-4316-9651-c61c80645c83 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.046558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83694f-e247-4355-9ebc-d5d2b558533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.047149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83694f-e247-4355-9ebc-d5d2b558533a None admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.047418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83694f-e247-4355-9ebc-d5d2b558533a None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.047676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83694f-e247-4355-9ebc-d5d2b558533a None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.048321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83694f-e247-4355-9ebc-d5d2b558533a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.049663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83694f-e247-4355-9ebc-d5d2b558533a None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.071908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 656/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:24 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:27.202061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699211-1ff3-4c5f-90f1-cd1ef433ee52 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.202932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699211-1ff3-4c5f-90f1-cd1ef433ee52 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.202932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699211-1ff3-4c5f-90f1-cd1ef433ee52 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.205063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 640/1296] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:27.210561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18bbe5-097a-41c7-a783-9d6210977875 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.210977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18bbe5-097a-41c7-a783-9d6210977875 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.211066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18bbe5-097a-41c7-a783-9d6210977875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.229730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-3f18bbe5-097a-41c7-a783-9d6210977875 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:27.230945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3f18bbe5-097a-41c7-a783-9d6210977875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:27.310286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 657/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:27.581043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44699211-1ff3-4c5f-90f1-cd1ef433ee52 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.690027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44699211-1ff3-4c5f-90f1-cd1ef433ee52 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.724647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.725257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.725523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.725780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.726379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.727744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:27.736624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:27.737718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:27.738612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 641/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:27.744349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18bbe5-097a-41c7-a783-9d6210977875 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.769114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:27.858421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18bbe5-097a-41c7-a783-9d6210977875 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.892302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.892903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.893178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.893439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.894085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:27.894357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:27.895763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:27.900815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 658/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:27.910447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.943226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:28.012702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e090d-c449-439f-8f87-9c5547fec924 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.059105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f09d-4724-4ebf-bcbb-4ba28f6c317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.059703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f09d-4724-4ebf-bcbb-4ba28f6c317a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.059979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f09d-4724-4ebf-bcbb-4ba28f6c317a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.060239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f09d-4724-4ebf-bcbb-4ba28f6c317a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.060927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f09d-4724-4ebf-bcbb-4ba28f6c317a None admin] RBAC: Adding query filter params (interface=public, service_id=efa278f6247646d7a91597d8003ef1c0, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:28.061229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f09d-4724-4ebf-bcbb-4ba28f6c317a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:28.062631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f09d-4724-4ebf-bcbb-4ba28f6c317a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:28.068180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 642/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/endpoints?service_id=efa278f6247646d7a91597d8003ef1c0&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:28.074249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:28.168050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:28.191621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7df0b9-c460-4df2-8252-38e567cf86e8 None admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.226922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71265f4b-a1fd-4f3e-a496-1aff7025efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.227539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265f4b-a1fd-4f3e-a496-1aff7025efb5 None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.227773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265f4b-a1fd-4f3e-a496-1aff7025efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.228067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265f4b-a1fd-4f3e-a496-1aff7025efb5 None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.228765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265f4b-a1fd-4f3e-a496-1aff7025efb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:28.230159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265f4b-a1fd-4f3e-a496-1aff7025efb5 None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:28.237173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 659/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 30 09:26:28 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:26:30.371201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e47b4-304e-411d-a62d-8201a7c68232 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.372059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e47b4-304e-411d-a62d-8201a7c68232 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.372059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e47b4-304e-411d-a62d-8201a7c68232 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.374186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 643/1302] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:26:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:30.379667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdae88-95ed-4bc3-bf9d-cb877801325a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.380083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdae88-95ed-4bc3-bf9d-cb877801325a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.380189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdae88-95ed-4bc3-bf9d-cb877801325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.400445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a4fdae88-95ed-4bc3-bf9d-cb877801325a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:30.401621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a4fdae88-95ed-4bc3-bf9d-cb877801325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:30.470762 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 660/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:26:30.736009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e47b4-304e-411d-a62d-8201a7c68232 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.848243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.857158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e47b4-304e-411d-a62d-8201a7c68232 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.893490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.894140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.894415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.894686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.895263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.896647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:30.905955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:30.907092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: ERROR keystone.server.flask.application Sep 30 09:26:30.908111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 644/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:30.916528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdae88-95ed-4bc3-bf9d-cb877801325a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.997072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.032133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdae88-95ed-4bc3-bf9d-cb877801325a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.068248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf53b0-ad33-4742-99f1-64e90f8acaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.068846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf53b0-ad33-4742-99f1-64e90f8acaae None admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.069115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf53b0-ad33-4742-99f1-64e90f8acaae None admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.069377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf53b0-ad33-4742-99f1-64e90f8acaae None admin] PATH_INFO: `/v3/services` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.070020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf53b0-ad33-4742-99f1-64e90f8acaae None admin] RBAC: Adding query filter params (name=placement) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.070319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf53b0-ad33-4742-99f1-64e90f8acaae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.071701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf53b0-ad33-4742-99f1-64e90f8acaae None admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.076936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 661/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:31.083298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.199151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ad9ac-4367-4059-81c5-8b1a96f32099 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.237129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39700715-ec11-45a9-90d3-1758811e68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.237714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700715-ec11-45a9-90d3-1758811e68f6 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.238066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700715-ec11-45a9-90d3-1758811e68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.238335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700715-ec11-45a9-90d3-1758811e68f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.238989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39700715-ec11-45a9-90d3-1758811e68f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.240364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39700715-ec11-45a9-90d3-1758811e68f6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.262654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 645/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:26:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:41.073820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=30 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.258070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:36.190094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd661-d1b6-4c23-9af0-d8c9943d2ebd None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.190637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd661-d1b6-4c23-9af0-d8c9943d2ebd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.190637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcd661-d1b6-4c23-9af0-d8c9943d2ebd None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.195927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 662/1307] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:36.197308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a643e4-861b-44d4-be2f-db3828eb4ff6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.197727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a643e4-861b-44d4-be2f-db3828eb4ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.198001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a643e4-861b-44d4-be2f-db3828eb4ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.312404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e5a643e4-861b-44d4-be2f-db3828eb4ff6 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:36.313733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e5a643e4-861b-44d4-be2f-db3828eb4ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:36.427480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 646/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:36.720308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba79b-43ec-4817-a54e-51055e73ced8 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.720594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba79b-43ec-4817-a54e-51055e73ced8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.720866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba79b-43ec-4817-a54e-51055e73ced8 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.722249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 663/1309] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 30 09:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:36.728477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ceb4f-3929-4fdd-9dae-e5e1f875b1ed None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.728827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ceb4f-3929-4fdd-9dae-e5e1f875b1ed None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.729223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ceb4f-3929-4fdd-9dae-e5e1f875b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.815214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-745ceb4f-3929-4fdd-9dae-e5e1f875b1ed None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:36.816582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-745ceb4f-3929-4fdd-9dae-e5e1f875b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:36.839809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:36.901919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 647/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 30 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:36.911476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aba79b-43ec-4817-a54e-51055e73ced8 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:36.913381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b3aba79b-43ec-4817-a54e-51055e73ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:37.031223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aba79b-43ec-4817-a54e-51055e73ced8 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:37.112740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f293e7-4c91-4804-8491-3da4af6bee9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:37.113346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f293e7-4c91-4804-8491-3da4af6bee9e service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.113584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f293e7-4c91-4804-8491-3da4af6bee9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.113900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f293e7-4c91-4804-8491-3da4af6bee9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.115475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d2f293e7-4c91-4804-8491-3da4af6bee9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:37.174685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:37.233163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f293e7-4c91-4804-8491-3da4af6bee9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:37.234631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f293e7-4c91-4804-8491-3da4af6bee9e service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:37.253992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 664/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:27:39.688473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635a9a-2662-4b62-9588-94b05a4527e2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.689031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635a9a-2662-4b62-9588-94b05a4527e2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.689031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635a9a-2662-4b62-9588-94b05a4527e2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.690397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 648/1312] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:39.695777 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164813a-1461-4fb2-bcb4-0e1b5bb4a281 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.696281 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164813a-1461-4fb2-bcb4-0e1b5bb4a281 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.696373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164813a-1461-4fb2-bcb4-0e1b5bb4a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.778461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2164813a-1461-4fb2-bcb4-0e1b5bb4a281 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:39.779687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2164813a-1461-4fb2-bcb4-0e1b5bb4a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:39.885069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 665/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:40.162438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91635a9a-2662-4b62-9588-94b05a4527e2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.164398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-91635a9a-2662-4b62-9588-94b05a4527e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:40.283269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91635a9a-2662-4b62-9588-94b05a4527e2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.356333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.359396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ae01-cb85-4fe3-b1f0-7a7a4ac2d33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.360204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ae01-cb85-4fe3-b1f0-7a7a4ac2d33f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.360480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ae01-cb85-4fe3-b1f0-7a7a4ac2d33f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.360747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ae01-cb85-4fe3-b1f0-7a7a4ac2d33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.362988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4860ae01-cb85-4fe3-b1f0-7a7a4ac2d33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:40.480559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860ae01-cb85-4fe3-b1f0-7a7a4ac2d33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.481953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860ae01-cb85-4fe3-b1f0-7a7a4ac2d33f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.500068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 649/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:27:42.965355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad6621-6128-4821-b47f-a54d5a20db82 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.965958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad6621-6128-4821-b47f-a54d5a20db82 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.965958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad6621-6128-4821-b47f-a54d5a20db82 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.967346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 666/1315] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:42.972599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af46a1-45bc-4628-9175-afe5f4578557 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.973065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af46a1-45bc-4628-9175-afe5f4578557 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.973172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af46a1-45bc-4628-9175-afe5f4578557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.042847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d7af46a1-45bc-4628-9175-afe5f4578557 None None] MFA Rules not processed for user `bc74d33b575343409500f3f8dca19cca`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:43.043996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d7af46a1-45bc-4628-9175-afe5f4578557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:43.095717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.142135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 650/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:43.426164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad6621-6128-4821-b47f-a54d5a20db82 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.428611 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f6ad6621-6128-4821-b47f-a54d5a20db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:43.444833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.545604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad6621-6128-4821-b47f-a54d5a20db82 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.623208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4808a-32e9-44aa-885b-90778fee89e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.623815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4808a-32e9-44aa-885b-90778fee89e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.624070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4808a-32e9-44aa-885b-90778fee89e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.624336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4808a-32e9-44aa-885b-90778fee89e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.625944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-17b4808a-32e9-44aa-885b-90778fee89e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:43.689774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.744529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4808a-32e9-44aa-885b-90778fee89e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.746016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4808a-32e9-44aa-885b-90778fee89e3 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.764369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 667/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:27:46.464370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fde37-d07e-4314-815f-15356c03bae1 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.464984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fde37-d07e-4314-815f-15356c03bae1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.464984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fde37-d07e-4314-815f-15356c03bae1 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.466309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 651/1318] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:46.472765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e566-09e5-4f29-b310-01a5ee2ac644 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.473205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e566-09e5-4f29-b310-01a5ee2ac644 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e566-09e5-4f29-b310-01a5ee2ac644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.554524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1323e566-09e5-4f29-b310-01a5ee2ac644 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:46.555742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1323e566-09e5-4f29-b310-01a5ee2ac644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:46.657107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 668/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:46.940862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fde37-d07e-4314-815f-15356c03bae1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.943549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-173fde37-d07e-4314-815f-15356c03bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:47.071259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fde37-d07e-4314-815f-15356c03bae1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:47.149088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97953051-ea1c-4b0c-adf5-e1534b010202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:47.149679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97953051-ea1c-4b0c-adf5-e1534b010202 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.149979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97953051-ea1c-4b0c-adf5-e1534b010202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.150239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97953051-ea1c-4b0c-adf5-e1534b010202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.151834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-97953051-ea1c-4b0c-adf5-e1534b010202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:47.159308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.275220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97953051-ea1c-4b0c-adf5-e1534b010202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:47.276581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97953051-ea1c-4b0c-adf5-e1534b010202 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:47.298166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 652/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:27:50.078475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7240ca6-4430-4307-b597-c22dbd998a31 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.079051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7240ca6-4430-4307-b597-c22dbd998a31 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.079051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7240ca6-4430-4307-b597-c22dbd998a31 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.080512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 669/1321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:50.086238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5040c-97b3-4e02-ae85-87b8f8d48236 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.086692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5040c-97b3-4e02-ae85-87b8f8d48236 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.086807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5040c-97b3-4e02-ae85-87b8f8d48236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.160750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2cc5040c-97b3-4e02-ae85-87b8f8d48236 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:50.162045 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2cc5040c-97b3-4e02-ae85-87b8f8d48236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:50.233017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.276731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 653/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:50.567480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7a9d-8156-41db-88c1-015b0b5ae33e None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.567697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7a9d-8156-41db-88c1-015b0b5ae33e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.567928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7a9d-8156-41db-88c1-015b0b5ae33e None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.569315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 670/1323] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 30 09:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:50.575407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a8999-99eb-4d04-81eb-541becf775ee None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.575694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a8999-99eb-4d04-81eb-541becf775ee None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.575952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a8999-99eb-4d04-81eb-541becf775ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.659334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b94a8999-99eb-4d04-81eb-541becf775ee None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:50.660565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b94a8999-99eb-4d04-81eb-541becf775ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:50.739762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 654/1324] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 30 09:27:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:50.749058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7a9d-8156-41db-88c1-015b0b5ae33e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.750745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6a6c7a9d-8156-41db-88c1-015b0b5ae33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:50.771819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.859460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7a9d-8156-41db-88c1-015b0b5ae33e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.936099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0977a3-8890-4566-a274-24bcb55875e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.936713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0977a3-8890-4566-a274-24bcb55875e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.936985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0977a3-8890-4566-a274-24bcb55875e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.937250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0977a3-8890-4566-a274-24bcb55875e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.938885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ce0977a3-8890-4566-a274-24bcb55875e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:51.009762 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.048860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0977a3-8890-4566-a274-24bcb55875e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.050352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0977a3-8890-4566-a274-24bcb55875e0 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.069222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 671/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:27:53.495336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0e7a-668a-4dda-8c0e-8634880bcbbe None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.495874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0e7a-668a-4dda-8c0e-8634880bcbbe None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.495874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0e7a-668a-4dda-8c0e-8634880bcbbe None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.497120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 655/1326] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:53.502713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07518de-75b0-4d00-9f8e-29d95598bc4e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.503154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07518de-75b0-4d00-9f8e-29d95598bc4e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.503247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07518de-75b0-4d00-9f8e-29d95598bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.569720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a07518de-75b0-4d00-9f8e-29d95598bc4e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:53.571000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a07518de-75b0-4d00-9f8e-29d95598bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:53.674740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 672/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:53.948831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0e7a-668a-4dda-8c0e-8634880bcbbe None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.950489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b85b0e7a-668a-4dda-8c0e-8634880bcbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:54.014129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:54.058027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0e7a-668a-4dda-8c0e-8634880bcbbe None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:54.134348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d6e1-190a-49f7-926e-bc73bda1770f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:54.134948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d6e1-190a-49f7-926e-bc73bda1770f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.135214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d6e1-190a-49f7-926e-bc73bda1770f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.135471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d6e1-190a-49f7-926e-bc73bda1770f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.137045 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af99d6e1-190a-49f7-926e-bc73bda1770f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:54.247869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:54.250595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d6e1-190a-49f7-926e-bc73bda1770f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:54.252091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d6e1-190a-49f7-926e-bc73bda1770f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:54.271830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 656/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:27:56.499599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4745-971c-40cf-b068-171caaf826be None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.500139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4745-971c-40cf-b068-171caaf826be None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.500139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4745-971c-40cf-b068-171caaf826be None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.501554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 673/1329] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:56.507378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6222-e236-4989-8752-8d41fc601006 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.507863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6222-e236-4989-8752-8d41fc601006 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.508029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6222-e236-4989-8752-8d41fc601006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.582012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a0ea6222-e236-4989-8752-8d41fc601006 None None] MFA Rules not processed for user `bc74d33b575343409500f3f8dca19cca`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:56.583253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a0ea6222-e236-4989-8752-8d41fc601006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:56.687758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 657/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:27:56.965516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff4745-971c-40cf-b068-171caaf826be None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.967118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-41ff4745-971c-40cf-b068-171caaf826be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:56.999567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.074535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff4745-971c-40cf-b068-171caaf826be None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.153622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af022b-5856-4414-9172-a03147cf4f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.154264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af022b-5856-4414-9172-a03147cf4f5f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.154514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af022b-5856-4414-9172-a03147cf4f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.155439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af022b-5856-4414-9172-a03147cf4f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.156830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-09af022b-5856-4414-9172-a03147cf4f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:57.237476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.272505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af022b-5856-4414-9172-a03147cf4f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.274233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af022b-5856-4414-9172-a03147cf4f5f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.295729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 674/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:27:59.846816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664aae-231e-4d03-9763-75cdca8f5852 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.847711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664aae-231e-4d03-9763-75cdca8f5852 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.847711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664aae-231e-4d03-9763-75cdca8f5852 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.849740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 658/1332] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:27:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:59.856263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab3bb8-db53-42b3-9822-cb38511ae328 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.856941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab3bb8-db53-42b3-9822-cb38511ae328 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.857090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab3bb8-db53-42b3-9822-cb38511ae328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.933354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-8cab3bb8-db53-42b3-9822-cb38511ae328 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:59.934507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8cab3bb8-db53-42b3-9822-cb38511ae328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:00.042392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 675/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:28:00.321152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664aae-231e-4d03-9763-75cdca8f5852 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.322765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9c664aae-231e-4d03-9763-75cdca8f5852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:00.398035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:00.434966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664aae-231e-4d03-9763-75cdca8f5852 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.509983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b06a24-4059-4aba-a4b6-ea2c62852481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.510587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b06a24-4059-4aba-a4b6-ea2c62852481 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.510850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b06a24-4059-4aba-a4b6-ea2c62852481 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.511113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b06a24-4059-4aba-a4b6-ea2c62852481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.512695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-36b06a24-4059-4aba-a4b6-ea2c62852481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:00.632891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b06a24-4059-4aba-a4b6-ea2c62852481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.634488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b06a24-4059-4aba-a4b6-ea2c62852481 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.644792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:00.654598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 659/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:02.885748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec8dc-5c57-487d-ae89-5cc4d234d648 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.886317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec8dc-5c57-487d-ae89-5cc4d234d648 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.886317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec8dc-5c57-487d-ae89-5cc4d234d648 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.887611 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 676/1335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:02.893018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f3db6-ae07-490a-9cc5-6a712746db9d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.893471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f3db6-ae07-490a-9cc5-6a712746db9d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.893602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f3db6-ae07-490a-9cc5-6a712746db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.965375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1c2f3db6-ae07-490a-9cc5-6a712746db9d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:02.966599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1c2f3db6-ae07-490a-9cc5-6a712746db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:03.073012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 660/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:03.367310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec8dc-5c57-487d-ae89-5cc4d234d648 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.369589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-01dec8dc-5c57-487d-ae89-5cc4d234d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:03.426696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.494451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec8dc-5c57-487d-ae89-5cc4d234d648 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.571790 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92318a-91b5-4ea8-9cb7-c087e3c3cc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.572400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92318a-91b5-4ea8-9cb7-c087e3c3cc12 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.572677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92318a-91b5-4ea8-9cb7-c087e3c3cc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.572943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92318a-91b5-4ea8-9cb7-c087e3c3cc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.574574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4e92318a-91b5-4ea8-9cb7-c087e3c3cc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:03.670754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.702684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92318a-91b5-4ea8-9cb7-c087e3c3cc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.705433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92318a-91b5-4ea8-9cb7-c087e3c3cc12 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.724812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 677/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:06.330803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c2149-d570-475c-91f5-1560460e59b3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:06.331359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c2149-d570-475c-91f5-1560460e59b3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:06.331359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c2149-d570-475c-91f5-1560460e59b3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:06.332677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 661/1338] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:06.338557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93469-9531-4e26-8937-67a26dbf2328 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:06.339056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93469-9531-4e26-8937-67a26dbf2328 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:06.339159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93469-9531-4e26-8937-67a26dbf2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:06.428715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c5d93469-9531-4e26-8937-67a26dbf2328 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:06.429961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c5d93469-9531-4e26-8937-67a26dbf2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:06.536369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 678/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:06.821270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c2149-d570-475c-91f5-1560460e59b3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:06.822999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f56c2149-d570-475c-91f5-1560460e59b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:06.909342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:06.941426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c2149-d570-475c-91f5-1560460e59b3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:07.017954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfea233-6089-49a7-99a0-575fbd1e2fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:07.018563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea233-6089-49a7-99a0-575fbd1e2fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.018835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea233-6089-49a7-99a0-575fbd1e2fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.019100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea233-6089-49a7-99a0-575fbd1e2fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.020692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9cfea233-6089-49a7-99a0-575fbd1e2fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:07.144607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfea233-6089-49a7-99a0-575fbd1e2fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:07.146152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfea233-6089-49a7-99a0-575fbd1e2fd3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:07.166479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 662/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:11.392653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9d30-e824-43c4-8edd-6875db98de5a None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.393146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9d30-e824-43c4-8edd-6875db98de5a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.393146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9d30-e824-43c4-8edd-6875db98de5a None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.394765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 679/1341] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:11.400477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb2b4-a68c-4004-a8a1-c6e01fd81a33 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.400980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb2b4-a68c-4004-a8a1-c6e01fd81a33 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.401115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb2b4-a68c-4004-a8a1-c6e01fd81a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.407562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:11.472232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d55bb2b4-a68c-4004-a8a1-c6e01fd81a33 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:11.473434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d55bb2b4-a68c-4004-a8a1-c6e01fd81a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:11.579135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 663/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:11.863054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd9d30-e824-43c4-8edd-6875db98de5a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:11.865836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-27cd9d30-e824-43c4-8edd-6875db98de5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:11.922457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:11.980004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd9d30-e824-43c4-8edd-6875db98de5a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.056105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d5c6a-4677-49c6-931d-0758931349ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.056722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5c6a-4677-49c6-931d-0758931349ab service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.056956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5c6a-4677-49c6-931d-0758931349ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.057247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5c6a-4677-49c6-931d-0758931349ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.059013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1d4d5c6a-4677-49c6-931d-0758931349ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:12.153182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:12.171493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d5c6a-4677-49c6-931d-0758931349ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.172943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d5c6a-4677-49c6-931d-0758931349ab service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.191747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 680/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:14.992052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91dad-063c-4118-82a5-6c8bd68743c5 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.992621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91dad-063c-4118-82a5-6c8bd68743c5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.992621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91dad-063c-4118-82a5-6c8bd68743c5 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.993860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 664/1344] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:14.999258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4c41a-d14b-4981-8381-8bbad3204d9e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.999714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4c41a-d14b-4981-8381-8bbad3204d9e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.999816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4c41a-d14b-4981-8381-8bbad3204d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.070696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d2b4c41a-d14b-4981-8381-8bbad3204d9e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:15.071896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d2b4c41a-d14b-4981-8381-8bbad3204d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:15.169121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 681/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:15.453630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d91dad-063c-4118-82a5-6c8bd68743c5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.455259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-58d91dad-063c-4118-82a5-6c8bd68743c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:15.553422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:15.572712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d91dad-063c-4118-82a5-6c8bd68743c5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.653255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074101b3-e5de-4360-8c1f-65380c55a981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.653900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074101b3-e5de-4360-8c1f-65380c55a981 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.654180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074101b3-e5de-4360-8c1f-65380c55a981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.654447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074101b3-e5de-4360-8c1f-65380c55a981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.656417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-074101b3-e5de-4360-8c1f-65380c55a981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:15.770831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074101b3-e5de-4360-8c1f-65380c55a981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.772269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074101b3-e5de-4360-8c1f-65380c55a981 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.790482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 665/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:19.919826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010fdc-b441-4351-aa49-7d3895ad98ec None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.920322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010fdc-b441-4351-aa49-7d3895ad98ec None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.920322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010fdc-b441-4351-aa49-7d3895ad98ec None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.921673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 682/1347] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:19.927451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3e94-119a-4451-95a1-807f1e2e0751 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.927880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3e94-119a-4451-95a1-807f1e2e0751 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.927970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3e94-119a-4451-95a1-807f1e2e0751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.944434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.997525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bd0a3e94-119a-4451-95a1-807f1e2e0751 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:19.998767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bd0a3e94-119a-4451-95a1-807f1e2e0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:20.097074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 666/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:20.377834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69010fdc-b441-4351-aa49-7d3895ad98ec None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.380431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-69010fdc-b441-4351-aa49-7d3895ad98ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:20.452720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.504412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69010fdc-b441-4351-aa49-7d3895ad98ec None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.583620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662e0a-55ce-437a-a749-880cc4396e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.584218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662e0a-55ce-437a-a749-880cc4396e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.584501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662e0a-55ce-437a-a749-880cc4396e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.584745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662e0a-55ce-437a-a749-880cc4396e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.586360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f1662e0a-55ce-437a-a749-880cc4396e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:20.709737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.714068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662e0a-55ce-437a-a749-880cc4396e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.717285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662e0a-55ce-437a-a749-880cc4396e00 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.740765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 683/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:25.884980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0aa38-082e-4663-9985-74d6d534ef8a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:25.885448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0aa38-082e-4663-9985-74d6d534ef8a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:25.885546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0aa38-082e-4663-9985-74d6d534ef8a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:25.891140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 667/1350] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:28:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:25.899761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74540dd9-712e-42cb-9535-2727a9e5796f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:25.899761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74540dd9-712e-42cb-9535-2727a9e5796f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:25.905822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74540dd9-712e-42cb-9535-2727a9e5796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:26.066891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-74540dd9-712e-42cb-9535-2727a9e5796f None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:26.068871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-74540dd9-712e-42cb-9535-2727a9e5796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:26.202537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 684/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:28:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:30.095572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=59 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:30.164696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d18c9-1909-49ab-977f-75f0c35c5cc8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.164956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d18c9-1909-49ab-977f-75f0c35c5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.165238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d18c9-1909-49ab-977f-75f0c35c5cc8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:30.166887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 668/1352] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:30.172255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aad1ed-c093-4407-9910-e6068d9f951b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.172733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aad1ed-c093-4407-9910-e6068d9f951b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.172828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aad1ed-c093-4407-9910-e6068d9f951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:30.241227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:30.267994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-39aad1ed-c093-4407-9910-e6068d9f951b None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:30.269195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-39aad1ed-c093-4407-9910-e6068d9f951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:30.382126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 685/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:28:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:31.808165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192371f-e1dc-4e30-bff0-d9787da7d095 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:31.808759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192371f-e1dc-4e30-bff0-d9787da7d095 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:31.808759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192371f-e1dc-4e30-bff0-d9787da7d095 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:31.810115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 669/1354] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:31.815681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0b0a6-5010-424d-8f94-71c795662405 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:31.816110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0b0a6-5010-424d-8f94-71c795662405 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:31.816348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0b0a6-5010-424d-8f94-71c795662405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:31.893633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c2c0b0a6-5010-424d-8f94-71c795662405 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:31.894854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c2c0b0a6-5010-424d-8f94-71c795662405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:31.938624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:32.006649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 686/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:28:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:28:35.573188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb0ad-115d-4946-8fe8-c7ec8655957f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:35.574145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb0ad-115d-4946-8fe8-c7ec8655957f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:35.574685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb0ad-115d-4946-8fe8-c7ec8655957f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:35.576485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 670/1356] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:35.582635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf63027-72c9-45b2-b14e-50bcb2798e82 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:35.583496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf63027-72c9-45b2-b14e-50bcb2798e82 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:35.583884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf63027-72c9-45b2-b14e-50bcb2798e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:35.662122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1cf63027-72c9-45b2-b14e-50bcb2798e82 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:35.663736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1cf63027-72c9-45b2-b14e-50bcb2798e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:35.769160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 687/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:36.073316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b98cf-239d-474e-9790-9dbdd6441320 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.073776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b98cf-239d-474e-9790-9dbdd6441320 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.074242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b98cf-239d-474e-9790-9dbdd6441320 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.076347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 671/1358] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 30 09:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:36.084681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecf2b-590b-45f2-9ccd-79ac1c9afaf6 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.085070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecf2b-590b-45f2-9ccd-79ac1c9afaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.085430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecf2b-590b-45f2-9ccd-79ac1c9afaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.102682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.167159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c26ecf2b-590b-45f2-9ccd-79ac1c9afaf6 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:36.168619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c26ecf2b-590b-45f2-9ccd-79ac1c9afaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:36.302070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 688/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 09:28:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:36.304970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b98cf-239d-474e-9790-9dbdd6441320 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.306523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a10b98cf-239d-474e-9790-9dbdd6441320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:36.469294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b98cf-239d-474e-9790-9dbdd6441320 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:36.553423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.597728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1c814-1b34-4b5d-b4f2-4560e376f051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:36.598696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1c814-1b34-4b5d-b4f2-4560e376f051 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.599064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1c814-1b34-4b5d-b4f2-4560e376f051 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.599442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1c814-1b34-4b5d-b4f2-4560e376f051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.601256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5bc1c814-1b34-4b5d-b4f2-4560e376f051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:36.712584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1c814-1b34-4b5d-b4f2-4560e376f051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:36.714372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1c814-1b34-4b5d-b4f2-4560e376f051 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:36.734821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 672/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:39.121366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341da60-f72b-4979-b635-64ec5a93b7d3 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:39.121366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341da60-f72b-4979-b635-64ec5a93b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:39.122161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341da60-f72b-4979-b635-64ec5a93b7d3 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:39.122985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 689/1361] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:39.129172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e4ee-e07f-48d1-8b19-83b42541750f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:39.129730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e4ee-e07f-48d1-8b19-83b42541750f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:39.130037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e4ee-e07f-48d1-8b19-83b42541750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:39.208424 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-21c8e4ee-e07f-48d1-8b19-83b42541750f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:39.209662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-21c8e4ee-e07f-48d1-8b19-83b42541750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:39.249209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:39.317907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 673/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:39.603586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341da60-f72b-4979-b635-64ec5a93b7d3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:39.605299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f341da60-f72b-4979-b635-64ec5a93b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:39.684559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:39.786958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341da60-f72b-4979-b635-64ec5a93b7d3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:39.908448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4e030-8ee2-457d-a4db-d9cbc9e65979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:39.909904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4e030-8ee2-457d-a4db-d9cbc9e65979 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:39.909904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4e030-8ee2-457d-a4db-d9cbc9e65979 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:39.909904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4e030-8ee2-457d-a4db-d9cbc9e65979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:39.911342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e9d4e030-8ee2-457d-a4db-d9cbc9e65979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:39.933928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:40.002677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4e030-8ee2-457d-a4db-d9cbc9e65979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:40.004549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4e030-8ee2-457d-a4db-d9cbc9e65979 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:40.023038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 690/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:42.540693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb7be-ecab-4cb2-90b2-dc89a4cef540 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:42.541593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb7be-ecab-4cb2-90b2-dc89a4cef540 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:42.541930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb7be-ecab-4cb2-90b2-dc89a4cef540 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:42.543531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 674/1364] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:42.549086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6793a0-2759-44d4-b3ac-9bdf15f1f2f2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:42.549530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6793a0-2759-44d4-b3ac-9bdf15f1f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:42.549915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6793a0-2759-44d4-b3ac-9bdf15f1f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:42.634075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-9b6793a0-2759-44d4-b3ac-9bdf15f1f2f2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:42.635426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9b6793a0-2759-44d4-b3ac-9bdf15f1f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:42.781716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:42.785500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 691/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:43.077934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432334ec-bced-4b9b-b388-2840c191c710 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:43.078466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432334ec-bced-4b9b-b388-2840c191c710 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:43.078917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432334ec-bced-4b9b-b388-2840c191c710 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:43.080451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 675/1366] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 30 09:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:43.089202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1a47-54ee-4cf8-8634-a2f67aac3756 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:43.089755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1a47-54ee-4cf8-8634-a2f67aac3756 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:43.090195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1a47-54ee-4cf8-8634-a2f67aac3756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:43.211533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6f0c1a47-54ee-4cf8-8634-a2f67aac3756 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:43.213022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6f0c1a47-54ee-4cf8-8634-a2f67aac3756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:43.417829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 692/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 09:28:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:43.427601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432334ec-bced-4b9b-b388-2840c191c710 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:43.429178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-432334ec-bced-4b9b-b388-2840c191c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:43.694293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432334ec-bced-4b9b-b388-2840c191c710 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:43.717555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:43.846344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b545717-f358-4ea0-8c85-c491e272fc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:43.847136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b545717-f358-4ea0-8c85-c491e272fc06 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:43.847545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b545717-f358-4ea0-8c85-c491e272fc06 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:43.847909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b545717-f358-4ea0-8c85-c491e272fc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:43.849973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2b545717-f358-4ea0-8c85-c491e272fc06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:43.959423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b545717-f358-4ea0-8c85-c491e272fc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:43.961948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b545717-f358-4ea0-8c85-c491e272fc06 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:43.990246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 676/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:46.337025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c9113-4a79-4b4f-a640-853628204c2c None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:46.337604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c9113-4a79-4b4f-a640-853628204c2c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:46.337604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c9113-4a79-4b4f-a640-853628204c2c None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:46.344311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed463-d72e-4d09-8957-9f5db44e1003 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:46.345157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed463-d72e-4d09-8957-9f5db44e1003 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:46.345576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed463-d72e-4d09-8957-9f5db44e1003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:46.350473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 693/1369] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:46.381938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:46.426277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dd0ed463-d72e-4d09-8957-9f5db44e1003 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:46.427775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dd0ed463-d72e-4d09-8957-9f5db44e1003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:46.536723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 677/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:46.824906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c9113-4a79-4b4f-a640-853628204c2c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:46.828546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-224c9113-4a79-4b4f-a640-853628204c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:46.958662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:47.155508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c9113-4a79-4b4f-a640-853628204c2c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:47.310782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db1b74-a635-4f83-9af2-7522676a9c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:47.311819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1b74-a635-4f83-9af2-7522676a9c92 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.312512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1b74-a635-4f83-9af2-7522676a9c92 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.313103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1b74-a635-4f83-9af2-7522676a9c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.315048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-10db1b74-a635-4f83-9af2-7522676a9c92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:47.325536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:47.427614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db1b74-a635-4f83-9af2-7522676a9c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:47.429351 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db1b74-a635-4f83-9af2-7522676a9c92 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:47.449591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 694/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:47.622980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55594d4-ceae-48d3-a3d5-ee61b939d2cd None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.622980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55594d4-ceae-48d3-a3d5-ee61b939d2cd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.622980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55594d4-ceae-48d3-a3d5-ee61b939d2cd None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.624688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 678/1372] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:47.630411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456ce3c-6a1d-4f25-a7af-bbe8dfcf2b4e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.631030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456ce3c-6a1d-4f25-a7af-bbe8dfcf2b4e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.631294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456ce3c-6a1d-4f25-a7af-bbe8dfcf2b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.713360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d456ce3c-6a1d-4f25-a7af-bbe8dfcf2b4e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:47.714514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d456ce3c-6a1d-4f25-a7af-bbe8dfcf2b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:47.796007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:47.817178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 695/1373] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:48.148181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba878cd-6ebd-43de-9498-c6858f42a904 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:48.148181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba878cd-6ebd-43de-9498-c6858f42a904 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:48.148181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba878cd-6ebd-43de-9498-c6858f42a904 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:48.151409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 679/1374] 10.222.0.20 () {54 vars in 963 bytes} [Fri Sep 30 09:28:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:48.157159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d449-3cfe-4a21-a84e-6a281b626ea4 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:48.157473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d449-3cfe-4a21-a84e-6a281b626ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:48.157826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d449-3cfe-4a21-a84e-6a281b626ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:48.237527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4978d449-3cfe-4a21-a84e-6a281b626ea4 None None] MFA Rules not processed for user `b7c18108a06141b5b501241b919663bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:48.238908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4978d449-3cfe-4a21-a84e-6a281b626ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:48.323111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 696/1375] 10.222.0.20 () {58 vars in 1060 bytes} [Fri Sep 30 09:28:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:48.330699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba878cd-6ebd-43de-9498-c6858f42a904 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:48.332390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9ba878cd-6ebd-43de-9498-c6858f42a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:48.446575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba878cd-6ebd-43de-9498-c6858f42a904 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:48.450571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:48.523184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d3dac-1314-4bff-a9e6-3f2e785087d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7c18108a06141b5b501241b919663bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:48.523877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d3dac-1314-4bff-a9e6-3f2e785087d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:48.524205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d3dac-1314-4bff-a9e6-3f2e785087d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:48.524530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d3dac-1314-4bff-a9e6-3f2e785087d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:48.526226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-904d3dac-1314-4bff-a9e6-3f2e785087d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:48.660387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d3dac-1314-4bff-a9e6-3f2e785087d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:48.662021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d3dac-1314-4bff-a9e6-3f2e785087d5 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:48.681471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 680/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:49.647245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1732bb-ece7-4487-b64f-c74b8062d24f None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:49.647809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1732bb-ece7-4487-b64f-c74b8062d24f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:49.647809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1732bb-ece7-4487-b64f-c74b8062d24f None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:49.649093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 697/1377] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:49.654466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0963-b0b2-4e21-950b-9c2c95e83f57 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:49.654929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0963-b0b2-4e21-950b-9c2c95e83f57 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:49.656821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0963-b0b2-4e21-950b-9c2c95e83f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:49.705024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:49.732896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-883c0963-b0b2-4e21-950b-9c2c95e83f57 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:49.734039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-883c0963-b0b2-4e21-950b-9c2c95e83f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:49.841544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 681/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:50.134312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1732bb-ece7-4487-b64f-c74b8062d24f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.136152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9f1732bb-ece7-4487-b64f-c74b8062d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:50.233680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.312526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1732bb-ece7-4487-b64f-c74b8062d24f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.446212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f966c-c65d-4f31-85e3-2fe76918df9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.447117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f966c-c65d-4f31-85e3-2fe76918df9e service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.447385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f966c-c65d-4f31-85e3-2fe76918df9e service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.447649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f966c-c65d-4f31-85e3-2fe76918df9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.449258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-795f966c-c65d-4f31-85e3-2fe76918df9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:50.495280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.552347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f966c-c65d-4f31-85e3-2fe76918df9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.554603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f966c-c65d-4f31-85e3-2fe76918df9e service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.575368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 698/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:52.890818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed272-6551-41d3-8493-1ce49ebe2339 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:52.891854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed272-6551-41d3-8493-1ce49ebe2339 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:52.892343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed272-6551-41d3-8493-1ce49ebe2339 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:52.898377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 682/1380] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:52.900023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f0a53-bc92-4a16-abbd-4b49d02186e9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:52.900477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f0a53-bc92-4a16-abbd-4b49d02186e9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:52.900569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f0a53-bc92-4a16-abbd-4b49d02186e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:52.974313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ca7f0a53-bc92-4a16-abbd-4b49d02186e9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:52.974313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ca7f0a53-bc92-4a16-abbd-4b49d02186e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:53.102870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 699/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:53.392631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed272-6551-41d3-8493-1ce49ebe2339 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:53.394168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-694ed272-6551-41d3-8493-1ce49ebe2339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:53.506213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:53.551437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed272-6551-41d3-8493-1ce49ebe2339 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:53.684259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8263ea-adb3-4c21-baba-7a122261cec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:53.684927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8263ea-adb3-4c21-baba-7a122261cec9 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.685277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8263ea-adb3-4c21-baba-7a122261cec9 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.685607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8263ea-adb3-4c21-baba-7a122261cec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.687366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9a8263ea-adb3-4c21-baba-7a122261cec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:53.787556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:53.806379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8263ea-adb3-4c21-baba-7a122261cec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:53.808163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8263ea-adb3-4c21-baba-7a122261cec9 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:53.835633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 683/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:28:56.158842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708faa71-35ba-4da1-bb0c-02d83b88c696 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:56.159392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708faa71-35ba-4da1-bb0c-02d83b88c696 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:56.159392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708faa71-35ba-4da1-bb0c-02d83b88c696 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:56.160836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 700/1383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:56.166224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e273-c4cc-482a-b899-3f561931eb25 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:56.166684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e273-c4cc-482a-b899-3f561931eb25 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:56.166786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e273-c4cc-482a-b899-3f561931eb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:56.238083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-86a2e273-c4cc-482a-b899-3f561931eb25 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:56.239250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-86a2e273-c4cc-482a-b899-3f561931eb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:56.354150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 684/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:56.646650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708faa71-35ba-4da1-bb0c-02d83b88c696 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:56.648744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-708faa71-35ba-4da1-bb0c-02d83b88c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:56.671205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:56.815792 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708faa71-35ba-4da1-bb0c-02d83b88c696 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:56.922049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:56.947855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1377bd-2fc5-4a21-86fb-04ff1f028e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:56.948497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1377bd-2fc5-4a21-86fb-04ff1f028e6d service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:56.948772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1377bd-2fc5-4a21-86fb-04ff1f028e6d service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:56.949058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1377bd-2fc5-4a21-86fb-04ff1f028e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:56.950742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4c1377bd-2fc5-4a21-86fb-04ff1f028e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:57.048256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1377bd-2fc5-4a21-86fb-04ff1f028e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:57.050131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1377bd-2fc5-4a21-86fb-04ff1f028e6d service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:57.070880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 701/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:28:59.381951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54fe4e-b6c4-461f-bc41-339177f15e50 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.382520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54fe4e-b6c4-461f-bc41-339177f15e50 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.382520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54fe4e-b6c4-461f-bc41-339177f15e50 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.384049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 685/1386] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:59.390859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9641-2e37-4c9f-aaac-8fc07950781f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.391386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9641-2e37-4c9f-aaac-8fc07950781f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.391563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9641-2e37-4c9f-aaac-8fc07950781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.463889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-022b9641-2e37-4c9f-aaac-8fc07950781f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:59.465206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-022b9641-2e37-4c9f-aaac-8fc07950781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:59.521441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:59.570702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 702/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:28:59.876239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54fe4e-b6c4-461f-bc41-339177f15e50 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.877919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3f54fe4e-b6c4-461f-bc41-339177f15e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:59.944188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:00.059909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54fe4e-b6c4-461f-bc41-339177f15e50 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:00.209387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe140-083e-4a10-bf2f-b6146c79f8ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:00.210507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe140-083e-4a10-bf2f-b6146c79f8ad service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:00.211011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe140-083e-4a10-bf2f-b6146c79f8ad service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:00.211468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe140-083e-4a10-bf2f-b6146c79f8ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:00.214716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c58fe140-083e-4a10-bf2f-b6146c79f8ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:00.239666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:00.343601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe140-083e-4a10-bf2f-b6146c79f8ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:00.345342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe140-083e-4a10-bf2f-b6146c79f8ad service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:00.372146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 686/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:02.719422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fd71d-3790-4c34-b121-cc30c1dd750e None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:02.720042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fd71d-3790-4c34-b121-cc30c1dd750e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:02.720042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fd71d-3790-4c34-b121-cc30c1dd750e None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:02.721379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 703/1389] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:02.727109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029a74-5d0b-4001-8b42-7db11aae158d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:02.727536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029a74-5d0b-4001-8b42-7db11aae158d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:02.727640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029a74-5d0b-4001-8b42-7db11aae158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:02.795967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-96029a74-5d0b-4001-8b42-7db11aae158d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:02.797178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-96029a74-5d0b-4001-8b42-7db11aae158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:02.894223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:02.907383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 687/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:03.210658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fd71d-3790-4c34-b121-cc30c1dd750e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.212322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7b9fd71d-3790-4c34-b121-cc30c1dd750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:03.366959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fd71d-3790-4c34-b121-cc30c1dd750e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.408420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:03.483575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de764b-d29a-4b65-94d7-51a3f33de0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.484114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de764b-d29a-4b65-94d7-51a3f33de0ca service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.484390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de764b-d29a-4b65-94d7-51a3f33de0ca service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.484656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de764b-d29a-4b65-94d7-51a3f33de0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.486292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b5de764b-d29a-4b65-94d7-51a3f33de0ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:03.579147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de764b-d29a-4b65-94d7-51a3f33de0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:03.580769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de764b-d29a-4b65-94d7-51a3f33de0ca service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:03.600117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 704/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:04.222295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4570ec-fa25-4428-988f-bbe8c2ebf0ed None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.222900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4570ec-fa25-4428-988f-bbe8c2ebf0ed None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.222900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4570ec-fa25-4428-988f-bbe8c2ebf0ed None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.224405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 688/1392] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:04.229977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7938-aebd-4426-bc67-44ebd87a634b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.230474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7938-aebd-4426-bc67-44ebd87a634b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.230580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7938-aebd-4426-bc67-44ebd87a634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.285328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:04.300344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-52ed7938-aebd-4426-bc67-44ebd87a634b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:04.301671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-52ed7938-aebd-4426-bc67-44ebd87a634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:04.401488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 705/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:04.700348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf208881-f62d-4225-a716-4ef2977e1922 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.700649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf208881-f62d-4225-a716-4ef2977e1922 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.700916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf208881-f62d-4225-a716-4ef2977e1922 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.702388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 689/1394] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 30 09:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:04.707808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b02e8-4680-4ca9-bcd3-00ff3cb67d3d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:04.708062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b02e8-4680-4ca9-bcd3-00ff3cb67d3d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:04.708344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b02e8-4680-4ca9-bcd3-00ff3cb67d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:04.785459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-9f4b02e8-4680-4ca9-bcd3-00ff3cb67d3d None None] MFA Rules not processed for user `b77625f61bca4548af4cd5702d2b807a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:04.786767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9f4b02e8-4680-4ca9-bcd3-00ff3cb67d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:04.852994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:04.866076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 706/1395] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 30 09:29:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:04.875402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf208881-f62d-4225-a716-4ef2977e1922 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:04.876827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf208881-f62d-4225-a716-4ef2977e1922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:04.987046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf208881-f62d-4225-a716-4ef2977e1922 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:05.061842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aee5eb-54c5-4f88-bf1c-1fb4db8df672 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77625f61bca4548af4cd5702d2b807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:05.062469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee5eb-54c5-4f88-bf1c-1fb4db8df672 service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.062739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee5eb-54c5-4f88-bf1c-1fb4db8df672 service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.063000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee5eb-54c5-4f88-bf1c-1fb4db8df672 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.064566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-17aee5eb-54c5-4f88-bf1c-1fb4db8df672 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:05.108079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:05.176575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aee5eb-54c5-4f88-bf1c-1fb4db8df672 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:05.177951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aee5eb-54c5-4f88-bf1c-1fb4db8df672 service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:05.196934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 690/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:05.811838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585ae4a-de38-46d2-92a3-4c9a3f95a9a0 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.812451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585ae4a-de38-46d2-92a3-4c9a3f95a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.812451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585ae4a-de38-46d2-92a3-4c9a3f95a9a0 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.813741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 707/1397] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:05.820297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838ce2-15de-4ede-955b-13058db16859 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.820894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838ce2-15de-4ede-955b-13058db16859 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.820894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838ce2-15de-4ede-955b-13058db16859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.892309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a1838ce2-15de-4ede-955b-13058db16859 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:05.893782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a1838ce2-15de-4ede-955b-13058db16859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:05.966048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3d9e-1e1b-48f7-8d7c-41b7235d1c8b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.966323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3d9e-1e1b-48f7-8d7c-41b7235d1c8b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.966590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3d9e-1e1b-48f7-8d7c-41b7235d1c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.001069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.005834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 691/1398] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:06.033287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-af6c3d9e-1e1b-48f7-8d7c-41b7235d1c8b None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:06.034640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-af6c3d9e-1e1b-48f7-8d7c-41b7235d1c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:06.122262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 708/1399] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:29:06.170014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ae46-afe2-4ef7-a3fc-15868b1df17c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.170301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ae46-afe2-4ef7-a3fc-15868b1df17c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.170565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ae46-afe2-4ef7-a3fc-15868b1df17c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.171968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 692/1400] 10.222.0.20 () {54 vars in 943 bytes} [Fri Sep 30 09:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:06.178533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1e72-5b62-4aca-b84d-0f82d6ae34af None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.178822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1e72-5b62-4aca-b84d-0f82d6ae34af None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.179091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1e72-5b62-4aca-b84d-0f82d6ae34af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.257267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b20b1e72-5b62-4aca-b84d-0f82d6ae34af None None] MFA Rules not processed for user `861b64b65d2642afbacfa20851257333`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:06.258543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b20b1e72-5b62-4aca-b84d-0f82d6ae34af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:06.280554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.296587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872ae46-afe2-4ef7-a3fc-15868b1df17c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:06.298192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a872ae46-afe2-4ef7-a3fc-15868b1df17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:06.370636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 709/1401] 10.222.0.20 () {58 vars in 1040 bytes} [Fri Sep 30 09:29:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:06.379661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b1e72-5b62-4aca-b84d-0f82d6ae34af None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:06.389087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b1e72-5b62-4aca-b84d-0f82d6ae34af None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:06.445936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872ae46-afe2-4ef7-a3fc-15868b1df17c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:06.493162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481e9e2-9c8c-4b38-801c-84f26d1e7ae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:06.493774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e9e2-9c8c-4b38-801c-84f26d1e7ae1 service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.494106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e9e2-9c8c-4b38-801c-84f26d1e7ae1 service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.494375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e9e2-9c8c-4b38-801c-84f26d1e7ae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.496010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8481e9e2-9c8c-4b38-801c-84f26d1e7ae1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:06.517468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.523281 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.560249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd486c-fe8a-4181-a03a-d675ee553759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:06.560855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd486c-fe8a-4181-a03a-d675ee553759 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.561127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd486c-fe8a-4181-a03a-d675ee553759 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.561395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd486c-fe8a-4181-a03a-d675ee553759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.563048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0fbd486c-fe8a-4181-a03a-d675ee553759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:06.582109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e9e2-9c8c-4b38-801c-84f26d1e7ae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:06.583908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e9e2-9c8c-4b38-801c-84f26d1e7ae1 service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:06.592066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 710/1402] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 09:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:29:06.659073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd486c-fe8a-4181-a03a-d675ee553759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:06.661074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd486c-fe8a-4181-a03a-d675ee553759 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:06.681513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 693/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:08.912314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ca0cd-6f6e-4df2-b750-3e12fb8aad1d None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:08.912838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ca0cd-6f6e-4df2-b750-3e12fb8aad1d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:08.912838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ca0cd-6f6e-4df2-b750-3e12fb8aad1d None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:08.914150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 711/1404] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:08.919471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e569bf-2bee-4b8c-9d57-aa849c763026 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:08.919884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e569bf-2bee-4b8c-9d57-aa849c763026 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:08.920032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e569bf-2bee-4b8c-9d57-aa849c763026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:08.987724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-18e569bf-2bee-4b8c-9d57-aa849c763026 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:08.989052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-18e569bf-2bee-4b8c-9d57-aa849c763026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:09.027691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.091084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 694/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:09.382689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ca0cd-6f6e-4df2-b750-3e12fb8aad1d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.385224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f22ca0cd-6f6e-4df2-b750-3e12fb8aad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:09.544113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ca0cd-6f6e-4df2-b750-3e12fb8aad1d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.566856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.670481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38157c74-4a6b-4a62-ad8a-9d227b5608ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.671267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157c74-4a6b-4a62-ad8a-9d227b5608ab service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.671550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157c74-4a6b-4a62-ad8a-9d227b5608ab service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.671937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157c74-4a6b-4a62-ad8a-9d227b5608ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.673556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-38157c74-4a6b-4a62-ad8a-9d227b5608ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:09.772907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38157c74-4a6b-4a62-ad8a-9d227b5608ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.774970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38157c74-4a6b-4a62-ad8a-9d227b5608ab service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.795221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 712/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:12.040047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471657-25f7-4ae5-9783-db84095cd889 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:12.040643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471657-25f7-4ae5-9783-db84095cd889 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:12.040643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471657-25f7-4ae5-9783-db84095cd889 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:12.042032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 695/1407] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:12.047786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a645-aca4-464f-9395-7a151799f4ba None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:12.048280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a645-aca4-464f-9395-7a151799f4ba None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:12.048377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a645-aca4-464f-9395-7a151799f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:12.080179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:12.118472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c959a645-aca4-464f-9395-7a151799f4ba None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:12.119723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c959a645-aca4-464f-9395-7a151799f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:12.229951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 713/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:12.519018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0471657-25f7-4ae5-9783-db84095cd889 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:12.520958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d0471657-25f7-4ae5-9783-db84095cd889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:12.690282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0471657-25f7-4ae5-9783-db84095cd889 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:12.711656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:12.822218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e9fb0-2cb0-4d31-b2cc-e4a61e8395ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:12.822847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9fb0-2cb0-4d31-b2cc-e4a61e8395ab service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:12.823125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9fb0-2cb0-4d31-b2cc-e4a61e8395ab service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:12.823393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9fb0-2cb0-4d31-b2cc-e4a61e8395ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:12.825014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ce0e9fb0-2cb0-4d31-b2cc-e4a61e8395ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:12.928710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e9fb0-2cb0-4d31-b2cc-e4a61e8395ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:12.930890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e9fb0-2cb0-4d31-b2cc-e4a61e8395ab service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:12.950888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 696/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:22.224177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=54 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:22.948632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:29.668752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378400f-c538-4519-988a-fe912e5982c1 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:29.669330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378400f-c538-4519-988a-fe912e5982c1 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:29.669330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378400f-c538-4519-988a-fe912e5982c1 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:29.670599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 714/1410] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 30 09:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:29.676574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc5448-fd84-4642-871d-e0dbb3eabbea None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:29.677093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc5448-fd84-4642-871d-e0dbb3eabbea None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:29.677363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc5448-fd84-4642-871d-e0dbb3eabbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:29.764755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c3bc5448-fd84-4642-871d-e0dbb3eabbea None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:29.765988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c3bc5448-fd84-4642-871d-e0dbb3eabbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:29.879675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 697/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 30 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:29.895613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094694d-1eac-489c-8431-cd4ccaa4d3d5 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:29.896395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094694d-1eac-489c-8431-cd4ccaa4d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:29.896619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094694d-1eac-489c-8431-cd4ccaa4d3d5 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:29.898625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 715/1412] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 30 09:29:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:29.903806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b7f3-2fa0-4e5b-8e48-e04032a49693 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:29.904084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b7f3-2fa0-4e5b-8e48-e04032a49693 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:29.904346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b7f3-2fa0-4e5b-8e48-e04032a49693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:29.990234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:29.993361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c648b7f3-2fa0-4e5b-8e48-e04032a49693 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:29.995192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c648b7f3-2fa0-4e5b-8e48-e04032a49693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:30.122083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 698/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 30 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:32.709666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65d08c-9ff9-4bf3-befd-efb5ac70a896 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:32.710297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65d08c-9ff9-4bf3-befd-efb5ac70a896 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:32.710297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65d08c-9ff9-4bf3-befd-efb5ac70a896 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:32.711562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:32.717122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc065f-c9d7-4e08-b080-313d01e66222 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:32.717552 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc065f-c9d7-4e08-b080-313d01e66222 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:32.717643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc065f-c9d7-4e08-b080-313d01e66222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:32.787409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-60bc065f-c9d7-4e08-b080-313d01e66222 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:32.788605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-60bc065f-c9d7-4e08-b080-313d01e66222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:32.850714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:32.894035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:33.188110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65d08c-9ff9-4bf3-befd-efb5ac70a896 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:33.189965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9a65d08c-9ff9-4bf3-befd-efb5ac70a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:33.362008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65d08c-9ff9-4bf3-befd-efb5ac70a896 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:33.440091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:33.481978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814d492-b08f-4093-85f0-1352274d528c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:33.482588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814d492-b08f-4093-85f0-1352274d528c service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:33.482861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814d492-b08f-4093-85f0-1352274d528c service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:33.483128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814d492-b08f-4093-85f0-1352274d528c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:33.484720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2814d492-b08f-4093-85f0-1352274d528c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:33.596458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814d492-b08f-4093-85f0-1352274d528c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:33.598575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814d492-b08f-4093-85f0-1352274d528c service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:33.619833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 717/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:34.757336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644bd2-fafb-4616-9eb1-7b9a7147076a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:34.757940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644bd2-fafb-4616-9eb1-7b9a7147076a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:34.757940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644bd2-fafb-4616-9eb1-7b9a7147076a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:34.759134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:34.766639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fac35-6e55-44ce-becf-5b236f357fce None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:34.767092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fac35-6e55-44ce-becf-5b236f357fce None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:34.767198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fac35-6e55-44ce-becf-5b236f357fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:34.846455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ff7fac35-6e55-44ce-becf-5b236f357fce None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:34.847659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ff7fac35-6e55-44ce-becf-5b236f357fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:34.875483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:34.950547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:35.114953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644bd2-fafb-4616-9eb1-7b9a7147076a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:35.117452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8b644bd2-fafb-4616-9eb1-7b9a7147076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:35.278809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644bd2-fafb-4616-9eb1-7b9a7147076a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:35.322097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:35.395889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7bfc-591a-479e-aef5-ee9bd5a843c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:35.396542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7bfc-591a-479e-aef5-ee9bd5a843c0 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:35.397025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7bfc-591a-479e-aef5-ee9bd5a843c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:35.397382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7bfc-591a-479e-aef5-ee9bd5a843c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:35.398995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1d8c7bfc-591a-479e-aef5-ee9bd5a843c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:35.506389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7bfc-591a-479e-aef5-ee9bd5a843c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:35.507748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7bfc-591a-479e-aef5-ee9bd5a843c0 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:35.528047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 701/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:36.656220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b53ca-b434-4fa0-9070-474e80a11240 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:36.657112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b53ca-b434-4fa0-9070-474e80a11240 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:36.657112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b53ca-b434-4fa0-9070-474e80a11240 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:36.658486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:36.665201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d616-e076-4564-ae5f-1c72fd5f13a7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:36.665667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d616-e076-4564-ae5f-1c72fd5f13a7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:36.665771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d616-e076-4564-ae5f-1c72fd5f13a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:36.730755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:36.754534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-05a3d616-e076-4564-ae5f-1c72fd5f13a7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:36.756262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-05a3d616-e076-4564-ae5f-1c72fd5f13a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:36.859504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:37.012863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b53ca-b434-4fa0-9070-474e80a11240 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:37.015246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-641b53ca-b434-4fa0-9070-474e80a11240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:37.174826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b53ca-b434-4fa0-9070-474e80a11240 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:37.187969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:37.296260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc95bc2-45ab-4a1e-b2bc-cf513b7fe22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:37.297111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95bc2-45ab-4a1e-b2bc-cf513b7fe22d service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:37.297461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95bc2-45ab-4a1e-b2bc-cf513b7fe22d service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:37.297777 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95bc2-45ab-4a1e-b2bc-cf513b7fe22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:37.300267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-efc95bc2-45ab-4a1e-b2bc-cf513b7fe22d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:37.398987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc95bc2-45ab-4a1e-b2bc-cf513b7fe22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:37.400674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc95bc2-45ab-4a1e-b2bc-cf513b7fe22d service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:37.419719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 720/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:38.529732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de17cb-8909-41ac-8ed3-a701e145c8a4 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:38.530661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de17cb-8909-41ac-8ed3-a701e145c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:38.530661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de17cb-8909-41ac-8ed3-a701e145c8a4 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:38.533152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:38.541038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033ce5-d687-43a6-b118-9689642fe3db None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:38.541773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033ce5-d687-43a6-b118-9689642fe3db None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:38.541953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033ce5-d687-43a6-b118-9689642fe3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:38.571660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:38.637123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d6033ce5-d687-43a6-b118-9689642fe3db None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:38.638373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d6033ce5-d687-43a6-b118-9689642fe3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:38.737334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:38.886124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de17cb-8909-41ac-8ed3-a701e145c8a4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:38.888401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-64de17cb-8909-41ac-8ed3-a701e145c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:39.008546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:39.044870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de17cb-8909-41ac-8ed3-a701e145c8a4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:39.166426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1c903-973a-4ea0-9b92-b3476039e2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:39.166958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c903-973a-4ea0-9b92-b3476039e2dd service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:39.167230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c903-973a-4ea0-9b92-b3476039e2dd service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:39.167492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c903-973a-4ea0-9b92-b3476039e2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:39.169091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-edb1c903-973a-4ea0-9b92-b3476039e2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:39.251790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:39.267184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1c903-973a-4ea0-9b92-b3476039e2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:39.268794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1c903-973a-4ea0-9b92-b3476039e2dd service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:39.288556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 704/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:40.403086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634a98-d66e-43aa-b584-3ba166811bee None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:40.403666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634a98-d66e-43aa-b584-3ba166811bee None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:40.403666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634a98-d66e-43aa-b584-3ba166811bee None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:40.404968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:40.412672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88b80-63c4-4bde-bd1b-8ff35bd45ed9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:40.413623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88b80-63c4-4bde-bd1b-8ff35bd45ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:40.413623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88b80-63c4-4bde-bd1b-8ff35bd45ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:40.494724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a3e88b80-63c4-4bde-bd1b-8ff35bd45ed9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:40.495953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a3e88b80-63c4-4bde-bd1b-8ff35bd45ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:40.596046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:40.752471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634a98-d66e-43aa-b584-3ba166811bee None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:40.755017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ea634a98-d66e-43aa-b584-3ba166811bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:40.843806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:40.911863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634a98-d66e-43aa-b584-3ba166811bee None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:41.031415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f18221-c4f4-422c-9ebc-0871db134853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:41.032305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f18221-c4f4-422c-9ebc-0871db134853 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:41.032575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f18221-c4f4-422c-9ebc-0871db134853 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:41.032841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f18221-c4f4-422c-9ebc-0871db134853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:41.034463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f5f18221-c4f4-422c-9ebc-0871db134853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:41.083423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:41.125006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f18221-c4f4-422c-9ebc-0871db134853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:41.126651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f18221-c4f4-422c-9ebc-0871db134853 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:41.147669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 723/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:42.199128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec98e1-bab8-461f-be18-470fa526431c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:42.199970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec98e1-bab8-461f-be18-470fa526431c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:42.199970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec98e1-bab8-461f-be18-470fa526431c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:42.201976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:42.212081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c65a7-c2fc-4c05-9355-e0fd55f13222 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:42.212649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c65a7-c2fc-4c05-9355-e0fd55f13222 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:42.212649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c65a7-c2fc-4c05-9355-e0fd55f13222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:42.301086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b97c65a7-c2fc-4c05-9355-e0fd55f13222 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:42.302367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b97c65a7-c2fc-4c05-9355-e0fd55f13222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:42.408285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:42.557916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec98e1-bab8-461f-be18-470fa526431c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:42.559433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0eec98e1-bab8-461f-be18-470fa526431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:42.610345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:42.726664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec98e1-bab8-461f-be18-470fa526431c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:42.850047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a93e1-eeb7-4f77-bfa4-bdb1e5dc2774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:42.850524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a93e1-eeb7-4f77-bfa4-bdb1e5dc2774 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:42.850832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a93e1-eeb7-4f77-bfa4-bdb1e5dc2774 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:42.851124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a93e1-eeb7-4f77-bfa4-bdb1e5dc2774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:42.852691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af3a93e1-eeb7-4f77-bfa4-bdb1e5dc2774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:42.859939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:42.958555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a93e1-eeb7-4f77-bfa4-bdb1e5dc2774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:42.960222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a93e1-eeb7-4f77-bfa4-bdb1e5dc2774 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:42.979997 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 707/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:44.027559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de15-945f-41a6-85c4-256ec38a8113 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:44.028172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de15-945f-41a6-85c4-256ec38a8113 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:44.028172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de15-945f-41a6-85c4-256ec38a8113 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:44.029473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:44.037168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d0998-95de-4015-990b-111255f32562 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:44.038009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d0998-95de-4015-990b-111255f32562 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:44.038259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d0998-95de-4015-990b-111255f32562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:44.121718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-109d0998-95de-4015-990b-111255f32562 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:44.122945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-109d0998-95de-4015-990b-111255f32562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:44.204486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:44.235719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:44.386997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17de15-945f-41a6-85c4-256ec38a8113 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:44.388519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-db17de15-945f-41a6-85c4-256ec38a8113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:44.409444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:44.548791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17de15-945f-41a6-85c4-256ec38a8113 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:44.646143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:44.673963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35131db2-ebc1-4bcb-b741-c2d1e06d2af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:44.674576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131db2-ebc1-4bcb-b741-c2d1e06d2af0 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:44.674847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131db2-ebc1-4bcb-b741-c2d1e06d2af0 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:44.675113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131db2-ebc1-4bcb-b741-c2d1e06d2af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:44.676721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-35131db2-ebc1-4bcb-b741-c2d1e06d2af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:44.768349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35131db2-ebc1-4bcb-b741-c2d1e06d2af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:44.770009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35131db2-ebc1-4bcb-b741-c2d1e06d2af0 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:44.789227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 726/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:45.829883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af066-9f63-43a1-b1f1-2bfa4425c519 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:45.830713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af066-9f63-43a1-b1f1-2bfa4425c519 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:45.830713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af066-9f63-43a1-b1f1-2bfa4425c519 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:45.832868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:45.840816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211035fd-2b24-44fc-8f7e-0c813178a2af None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:45.841285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211035fd-2b24-44fc-8f7e-0c813178a2af None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:45.841383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211035fd-2b24-44fc-8f7e-0c813178a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:45.923162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-211035fd-2b24-44fc-8f7e-0c813178a2af None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:45.924378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-211035fd-2b24-44fc-8f7e-0c813178a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:45.968024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:46.027720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:46.178605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af066-9f63-43a1-b1f1-2bfa4425c519 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:46.180919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f09af066-9f63-43a1-b1f1-2bfa4425c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:46.367193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af066-9f63-43a1-b1f1-2bfa4425c519 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:46.426348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:46.486343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faa148-8659-4a39-8f8c-02bacd70d33c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:46.486868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa148-8659-4a39-8f8c-02bacd70d33c service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:46.487135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa148-8659-4a39-8f8c-02bacd70d33c service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:46.487400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa148-8659-4a39-8f8c-02bacd70d33c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:46.489002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-86faa148-8659-4a39-8f8c-02bacd70d33c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:46.587686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa148-8659-4a39-8f8c-02bacd70d33c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:46.589331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa148-8659-4a39-8f8c-02bacd70d33c service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:46.607836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 710/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:47.653698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c61a-a61d-40bb-bf6d-313c3ead8d1e None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:47.654251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c61a-a61d-40bb-bf6d-313c3ead8d1e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:47.654251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c61a-a61d-40bb-bf6d-313c3ead8d1e None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:47.655621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:47.663403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180de90-f024-4303-b296-1bfd0e014da7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:47.663897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180de90-f024-4303-b296-1bfd0e014da7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:47.663897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180de90-f024-4303-b296-1bfd0e014da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:47.758171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6180de90-f024-4303-b296-1bfd0e014da7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:47.759404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6180de90-f024-4303-b296-1bfd0e014da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:47.761430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:47.862858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:48.017157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0c61a-a61d-40bb-bf6d-313c3ead8d1e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:48.019670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ded0c61a-a61d-40bb-bf6d-313c3ead8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:48.178800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0c61a-a61d-40bb-bf6d-313c3ead8d1e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:48.207952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:48.299056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912a52b-af22-4e29-8e16-ceb43a87c13e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:48.299669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912a52b-af22-4e29-8e16-ceb43a87c13e service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:48.299937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912a52b-af22-4e29-8e16-ceb43a87c13e service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:48.300268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912a52b-af22-4e29-8e16-ceb43a87c13e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:48.301905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f912a52b-af22-4e29-8e16-ceb43a87c13e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:48.411849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912a52b-af22-4e29-8e16-ceb43a87c13e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:48.413652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912a52b-af22-4e29-8e16-ceb43a87c13e service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:48.432996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 729/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:50.497517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19739ed5-0618-4dda-aca0-6eef8e553b5d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:50.498567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19739ed5-0618-4dda-aca0-6eef8e553b5d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:50.498567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19739ed5-0618-4dda-aca0-6eef8e553b5d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:50.500554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:29:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:50.506726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77773cb-4476-461b-bb98-24f5885acca8 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:50.507181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77773cb-4476-461b-bb98-24f5885acca8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:50.507308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77773cb-4476-461b-bb98-24f5885acca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:50.550702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:50.578919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b77773cb-4476-461b-bb98-24f5885acca8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:50.580164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b77773cb-4476-461b-bb98-24f5885acca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:50.683432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:50.964529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19739ed5-0618-4dda-aca0-6eef8e553b5d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:50.966121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-19739ed5-0618-4dda-aca0-6eef8e553b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:51.081354 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19739ed5-0618-4dda-aca0-6eef8e553b5d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:51.114849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:51.161491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ac50-8b46-4b23-a410-da2970ae757a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:51.162163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ac50-8b46-4b23-a410-da2970ae757a service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:51.162596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ac50-8b46-4b23-a410-da2970ae757a service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:51.163039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ac50-8b46-4b23-a410-da2970ae757a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:51.164650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bc26ac50-8b46-4b23-a410-da2970ae757a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:51.299964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ac50-8b46-4b23-a410-da2970ae757a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:51.301428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ac50-8b46-4b23-a410-da2970ae757a service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:51.321102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 713/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:53.597442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015680b-1d28-408d-9c04-429d8eef6729 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:53.598066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015680b-1d28-408d-9c04-429d8eef6729 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:53.598066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015680b-1d28-408d-9c04-429d8eef6729 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:53.599360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:53.606079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31421d1-4936-49d3-b627-082998d52f8e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:53.606553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31421d1-4936-49d3-b627-082998d52f8e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:53.606676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31421d1-4936-49d3-b627-082998d52f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:53.684808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d31421d1-4936-49d3-b627-082998d52f8e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:53.685964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d31421d1-4936-49d3-b627-082998d52f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:53.700326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:53.793013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:54.077459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015680b-1d28-408d-9c04-429d8eef6729 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:54.079057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8015680b-1d28-408d-9c04-429d8eef6729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:54.193400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015680b-1d28-408d-9c04-429d8eef6729 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:54.206801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:54.275908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e1f78-80c9-4b28-920d-aead12c5338d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:54.276517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e1f78-80c9-4b28-920d-aead12c5338d service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:54.276788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e1f78-80c9-4b28-920d-aead12c5338d service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:54.277050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e1f78-80c9-4b28-920d-aead12c5338d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:54.278686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-888e1f78-80c9-4b28-920d-aead12c5338d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:54.393538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e1f78-80c9-4b28-920d-aead12c5338d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:54.394938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e1f78-80c9-4b28-920d-aead12c5338d service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:54.414300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 732/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:29:56.885722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f80bb1-1cfd-4405-885e-ee559620d9a9 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:56.886559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f80bb1-1cfd-4405-885e-ee559620d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:56.886559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f80bb1-1cfd-4405-885e-ee559620d9a9 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:56.888762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:56.894411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544ce6d-35fd-4922-bc95-847264f67a62 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:56.894844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544ce6d-35fd-4922-bc95-847264f67a62 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:56.894938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544ce6d-35fd-4922-bc95-847264f67a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:56.944354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:56.963953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b544ce6d-35fd-4922-bc95-847264f67a62 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:56.965186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b544ce6d-35fd-4922-bc95-847264f67a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:57.065965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:29:57.351757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f80bb1-1cfd-4405-885e-ee559620d9a9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:57.353305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-36f80bb1-1cfd-4405-885e-ee559620d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:57.466450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f80bb1-1cfd-4405-885e-ee559620d9a9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:57.507468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:57.548476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e5e20-66d9-4e31-9d8f-8fb773510054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:57.549080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5e20-66d9-4e31-9d8f-8fb773510054 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:57.549350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5e20-66d9-4e31-9d8f-8fb773510054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:57.549612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e5e20-66d9-4e31-9d8f-8fb773510054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:57.551252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d89e5e20-66d9-4e31-9d8f-8fb773510054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:57.682976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e5e20-66d9-4e31-9d8f-8fb773510054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:57.684431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e5e20-66d9-4e31-9d8f-8fb773510054 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:57.703786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 716/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:29:59.978276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af43a-7c08-45ef-b967-6bf494eecb0a None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:59.978919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af43a-7c08-45ef-b967-6bf494eecb0a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:59.978919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af43a-7c08-45ef-b967-6bf494eecb0a None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:59.980163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:59.987980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8b21-10ef-40aa-8e1b-ea2a77698b18 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:59.988854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8b21-10ef-40aa-8e1b-ea2a77698b18 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:59.989639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8b21-10ef-40aa-8e1b-ea2a77698b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:00.080752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-06ab8b21-10ef-40aa-8e1b-ea2a77698b18 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:00.082019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-06ab8b21-10ef-40aa-8e1b-ea2a77698b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:00.104523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:00.193132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:00.517478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af43a-7c08-45ef-b967-6bf494eecb0a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:00.520055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2e0af43a-7c08-45ef-b967-6bf494eecb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:00.654880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af43a-7c08-45ef-b967-6bf494eecb0a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:00.685496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:00.746794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edca1e6-1905-4012-8434-d725b3baf383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:00.747405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca1e6-1905-4012-8434-d725b3baf383 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:00.747674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca1e6-1905-4012-8434-d725b3baf383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:00.747936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca1e6-1905-4012-8434-d725b3baf383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:00.749570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1edca1e6-1905-4012-8434-d725b3baf383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:00.877204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edca1e6-1905-4012-8434-d725b3baf383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:00.878735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edca1e6-1905-4012-8434-d725b3baf383 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:00.897922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 735/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:03.119158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735d20-5172-40c8-883b-184997e6bcb4 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:03.119772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735d20-5172-40c8-883b-184997e6bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:03.119772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735d20-5172-40c8-883b-184997e6bcb4 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:03.121058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:03.130049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800356f-e8c6-49ad-bafb-cbc66043eec6 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:03.130754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800356f-e8c6-49ad-bafb-cbc66043eec6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:03.130969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800356f-e8c6-49ad-bafb-cbc66043eec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:03.204550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:03.207507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f800356f-e8c6-49ad-bafb-cbc66043eec6 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:03.209813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f800356f-e8c6-49ad-bafb-cbc66043eec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:03.311031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:03.600334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735d20-5172-40c8-883b-184997e6bcb4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:03.603213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c7735d20-5172-40c8-883b-184997e6bcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:03.728982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735d20-5172-40c8-883b-184997e6bcb4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:03.780473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:03.807928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0232e1-60ee-4dfb-af49-33fe24501a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:03.808509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0232e1-60ee-4dfb-af49-33fe24501a1b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:03.808784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0232e1-60ee-4dfb-af49-33fe24501a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:03.809058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0232e1-60ee-4dfb-af49-33fe24501a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:03.810689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7b0232e1-60ee-4dfb-af49-33fe24501a1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:03.927396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0232e1-60ee-4dfb-af49-33fe24501a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:03.928924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0232e1-60ee-4dfb-af49-33fe24501a1b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:03.949076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 719/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:06.204265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d4ba-82ef-41c8-851f-abc797dc0a36 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:06.205091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d4ba-82ef-41c8-851f-abc797dc0a36 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:06.205091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d4ba-82ef-41c8-851f-abc797dc0a36 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:06.207130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:30:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:06.212810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fff64-5ae4-4261-b974-fbfcb3179bef None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:06.213266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fff64-5ae4-4261-b974-fbfcb3179bef None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:06.213376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fff64-5ae4-4261-b974-fbfcb3179bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:06.289868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-917fff64-5ae4-4261-b974-fbfcb3179bef None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:06.291084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-917fff64-5ae4-4261-b974-fbfcb3179bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:06.320152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:06.388348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:30:06.671727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d4ba-82ef-41c8-851f-abc797dc0a36 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:06.673283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e2c1d4ba-82ef-41c8-851f-abc797dc0a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:06.792737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d4ba-82ef-41c8-851f-abc797dc0a36 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:06.822327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:06.867629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5eff9-072d-4e64-8d45-016c1d4bfa06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:06.868237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5eff9-072d-4e64-8d45-016c1d4bfa06 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:06.868506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5eff9-072d-4e64-8d45-016c1d4bfa06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:06.868768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5eff9-072d-4e64-8d45-016c1d4bfa06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:06.870499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-08c5eff9-072d-4e64-8d45-016c1d4bfa06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:06.983804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5eff9-072d-4e64-8d45-016c1d4bfa06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:06.985143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5eff9-072d-4e64-8d45-016c1d4bfa06 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:07.003851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 738/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:09.201505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0eb6e-821c-4248-8b83-cf9d6d1123d3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:09.202165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0eb6e-821c-4248-8b83-cf9d6d1123d3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:09.202165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0eb6e-821c-4248-8b83-cf9d6d1123d3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:09.203415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:09.210095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888bbce-5dcf-4818-83fc-609f99c9a82e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:09.210833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888bbce-5dcf-4818-83fc-609f99c9a82e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:09.211029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888bbce-5dcf-4818-83fc-609f99c9a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:09.288797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6888bbce-5dcf-4818-83fc-609f99c9a82e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:09.290082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6888bbce-5dcf-4818-83fc-609f99c9a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:09.300007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:09.394848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:09.672827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0eb6e-821c-4248-8b83-cf9d6d1123d3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:09.674393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d4a0eb6e-821c-4248-8b83-cf9d6d1123d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:09.783158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0eb6e-821c-4248-8b83-cf9d6d1123d3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:09.844483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:09.869567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c1e9-1031-4acb-b826-bc0059fa0ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:09.870237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c1e9-1031-4acb-b826-bc0059fa0ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:09.870514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c1e9-1031-4acb-b826-bc0059fa0ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:09.870777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c1e9-1031-4acb-b826-bc0059fa0ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:09.872438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0367c1e9-1031-4acb-b826-bc0059fa0ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:09.997565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c1e9-1031-4acb-b826-bc0059fa0ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:09.999073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c1e9-1031-4acb-b826-bc0059fa0ecf service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:10.017351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 722/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:12.275482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6e164-d1b2-4275-9f8b-29045e21e316 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:12.276319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6e164-d1b2-4275-9f8b-29045e21e316 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:12.276319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6e164-d1b2-4275-9f8b-29045e21e316 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:12.278264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:30:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:12.284129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b800ba-ff31-4bfc-97bd-f40733c624eb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:12.284608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b800ba-ff31-4bfc-97bd-f40733c624eb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:12.284707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b800ba-ff31-4bfc-97bd-f40733c624eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:12.356634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-26b800ba-ff31-4bfc-97bd-f40733c624eb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:12.357869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26b800ba-ff31-4bfc-97bd-f40733c624eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:12.398617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:12.459907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:12.751925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6e164-d1b2-4275-9f8b-29045e21e316 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:12.754483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-78f6e164-d1b2-4275-9f8b-29045e21e316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:12.870161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6e164-d1b2-4275-9f8b-29045e21e316 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:12.910092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:12.950386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8c97-aef6-498d-8935-239838a75e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:12.951003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8c97-aef6-498d-8935-239838a75e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:12.951277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8c97-aef6-498d-8935-239838a75e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:12.951546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8c97-aef6-498d-8935-239838a75e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:12.953133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a2ee8c97-aef6-498d-8935-239838a75e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:13.072692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8c97-aef6-498d-8935-239838a75e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:13.074160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8c97-aef6-498d-8935-239838a75e74 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:13.093367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 741/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:15.243397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045a71b-f241-4ead-b308-71f07b6be90f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:15.244021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045a71b-f241-4ead-b308-71f07b6be90f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:15.244021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045a71b-f241-4ead-b308-71f07b6be90f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:15.245281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:15.252065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef17f99-1338-46d4-8368-1cd6c8716cd5 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:15.252512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef17f99-1338-46d4-8368-1cd6c8716cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:15.252637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef17f99-1338-46d4-8368-1cd6c8716cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:15.323651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7ef17f99-1338-46d4-8368-1cd6c8716cd5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:15.324907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7ef17f99-1338-46d4-8368-1cd6c8716cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:15.344611 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:15.432029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:15.724493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045a71b-f241-4ead-b308-71f07b6be90f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:15.727196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4045a71b-f241-4ead-b308-71f07b6be90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:15.842925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045a71b-f241-4ead-b308-71f07b6be90f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:15.918707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:15.925720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5a342-2acd-40a5-8744-c428d4b5f5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:15.926377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5a342-2acd-40a5-8744-c428d4b5f5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:15.926630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5a342-2acd-40a5-8744-c428d4b5f5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:15.926891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5a342-2acd-40a5-8744-c428d4b5f5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:15.928579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d9e5a342-2acd-40a5-8744-c428d4b5f5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:16.056503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5a342-2acd-40a5-8744-c428d4b5f5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:16.058071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5a342-2acd-40a5-8744-c428d4b5f5f6 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:16.077682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 725/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:18.242715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095ed8-4976-4329-957a-b229e953e110 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:18.243243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095ed8-4976-4329-957a-b229e953e110 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:18.243243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095ed8-4976-4329-957a-b229e953e110 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:18.245190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:18.254241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98543aa7-4cf8-4edd-b2b7-5db0a46481e5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:18.254668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98543aa7-4cf8-4edd-b2b7-5db0a46481e5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:18.254778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98543aa7-4cf8-4edd-b2b7-5db0a46481e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:18.336686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-98543aa7-4cf8-4edd-b2b7-5db0a46481e5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:18.337922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-98543aa7-4cf8-4edd-b2b7-5db0a46481e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:18.524126 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:18.574784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:18.853726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20095ed8-4976-4329-957a-b229e953e110 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:18.855331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-20095ed8-4976-4329-957a-b229e953e110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:18.965380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20095ed8-4976-4329-957a-b229e953e110 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:19.014946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:19.042810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaede341-75ed-4e39-bfb1-5e3bf940ee46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:19.043350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaede341-75ed-4e39-bfb1-5e3bf940ee46 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:19.043625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaede341-75ed-4e39-bfb1-5e3bf940ee46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:19.043891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaede341-75ed-4e39-bfb1-5e3bf940ee46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:19.045498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-eaede341-75ed-4e39-bfb1-5e3bf940ee46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:19.159312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaede341-75ed-4e39-bfb1-5e3bf940ee46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:19.160885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaede341-75ed-4e39-bfb1-5e3bf940ee46 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:19.179821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 744/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:28.573206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=22 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:29.177247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=66 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:39.197629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d57a-9877-480b-a257-b83762614db8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.198258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d57a-9877-480b-a257-b83762614db8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.198258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d57a-9877-480b-a257-b83762614db8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.199544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 727/1471] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:39.206638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b7f39-11db-4625-a3b4-bc438082fc6f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.207108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b7f39-11db-4625-a3b4-bc438082fc6f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.207286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b7f39-11db-4625-a3b4-bc438082fc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.412825 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-899b7f39-11db-4625-a3b4-bc438082fc6f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:39.414103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-899b7f39-11db-4625-a3b4-bc438082fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:39.518157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 745/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:39.822295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224141bf-869f-4ce6-8b10-d6c192b8334a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.822593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224141bf-869f-4ce6-8b10-d6c192b8334a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.822857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224141bf-869f-4ce6-8b10-d6c192b8334a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.824178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 728/1473] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 30 09:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:39.829334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390c9c-aa34-4c37-b3ec-fd2c05661268 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.829617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390c9c-aa34-4c37-b3ec-fd2c05661268 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.829929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390c9c-aa34-4c37-b3ec-fd2c05661268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.914604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-45390c9c-aa34-4c37-b3ec-fd2c05661268 None None] MFA Rules not processed for user `b77625f61bca4548af4cd5702d2b807a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:39.915828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-45390c9c-aa34-4c37-b3ec-fd2c05661268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:39.938668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:39.996397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 746/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 30 09:30:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:40.004333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224141bf-869f-4ce6-8b10-d6c192b8334a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:40.006001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-224141bf-869f-4ce6-8b10-d6c192b8334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:40.121754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224141bf-869f-4ce6-8b10-d6c192b8334a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:40.204337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d5b64-13c0-4bf8-b702-f207c3aee8a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77625f61bca4548af4cd5702d2b807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:40.205049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5b64-13c0-4bf8-b702-f207c3aee8a7 service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:40.205145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5b64-13c0-4bf8-b702-f207c3aee8a7 service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:40.205442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5b64-13c0-4bf8-b702-f207c3aee8a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:40.207072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a02d5b64-13c0-4bf8-b702-f207c3aee8a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:40.263323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:40.331982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5b64-13c0-4bf8-b702-f207c3aee8a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:40.333443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5b64-13c0-4bf8-b702-f207c3aee8a7 service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:40.352770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 729/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:42.579575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81ce66-5b71-45b0-b372-f325738797d6 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:42.580183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81ce66-5b71-45b0-b372-f325738797d6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:42.580183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81ce66-5b71-45b0-b372-f325738797d6 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:42.581949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 747/1476] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:42.588894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48d01-f372-4e5e-a7c5-dd88c5254aa8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:42.589456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48d01-f372-4e5e-a7c5-dd88c5254aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:42.589456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48d01-f372-4e5e-a7c5-dd88c5254aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:42.667922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bcf48d01-f372-4e5e-a7c5-dd88c5254aa8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:42.669121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bcf48d01-f372-4e5e-a7c5-dd88c5254aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:42.781935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 730/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:43.061493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81ce66-5b71-45b0-b372-f325738797d6 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:43.063100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6a81ce66-5b71-45b0-b372-f325738797d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:43.212065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81ce66-5b71-45b0-b372-f325738797d6 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:43.267208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:43.312303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d04f93-f653-4518-8458-2dac9417b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:43.312830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d04f93-f653-4518-8458-2dac9417b049 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:43.313099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d04f93-f653-4518-8458-2dac9417b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:43.313363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d04f93-f653-4518-8458-2dac9417b049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:43.314065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d04f93-f653-4518-8458-2dac9417b049 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:43.315827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-38d04f93-f653-4518-8458-2dac9417b049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:30:43.315827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:30:43.315827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:30:43.316903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d04f93-f653-4518-8458-2dac9417b049 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:43.335757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 748/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:43 2022] GET /identity/v3/projects => generated 2553 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:30:45.524729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60804dd-ede7-49d0-847d-71e5f13ff400 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:45.525295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60804dd-ede7-49d0-847d-71e5f13ff400 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:45.525295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60804dd-ede7-49d0-847d-71e5f13ff400 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:45.526806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 731/1479] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:45.532181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562421-19f3-4696-90d3-9277fdbee4aa None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:45.532621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562421-19f3-4696-90d3-9277fdbee4aa None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:45.533170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f562421-19f3-4696-90d3-9277fdbee4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:45.601638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7f562421-19f3-4696-90d3-9277fdbee4aa None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:45.602834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7f562421-19f3-4696-90d3-9277fdbee4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:45.701000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 749/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:46.001991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60804dd-ede7-49d0-847d-71e5f13ff400 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:46.003592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f60804dd-ede7-49d0-847d-71e5f13ff400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:46.013775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:46.153586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60804dd-ede7-49d0-847d-71e5f13ff400 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:46.238392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:46.273647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38afda-e91e-447f-9fb3-c7d9544ca8da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:46.274291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38afda-e91e-447f-9fb3-c7d9544ca8da service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:46.274561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38afda-e91e-447f-9fb3-c7d9544ca8da service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:46.274821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38afda-e91e-447f-9fb3-c7d9544ca8da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:46.276443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5b38afda-e91e-447f-9fb3-c7d9544ca8da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:46.369748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38afda-e91e-447f-9fb3-c7d9544ca8da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:46.371423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38afda-e91e-447f-9fb3-c7d9544ca8da service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:46.389979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 732/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:48.724241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73996-2b1e-4bd4-9e03-dbde46dcdfcd None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.724780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73996-2b1e-4bd4-9e03-dbde46dcdfcd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.724780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73996-2b1e-4bd4-9e03-dbde46dcdfcd None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.726357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 750/1482] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:30:48.732091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b669-33da-48ff-a6dc-612fcb2bbf51 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.732563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b669-33da-48ff-a6dc-612fcb2bbf51 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.732648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b669-33da-48ff-a6dc-612fcb2bbf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.806716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9477b669-33da-48ff-a6dc-612fcb2bbf51 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:48.807937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9477b669-33da-48ff-a6dc-612fcb2bbf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:48.856851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:48.909541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 733/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:49.202893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73996-2b1e-4bd4-9e03-dbde46dcdfcd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:49.204534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-74f73996-2b1e-4bd4-9e03-dbde46dcdfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:49.230322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:49.316313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73996-2b1e-4bd4-9e03-dbde46dcdfcd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:49.395990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c7213-ecfd-4658-beb3-aae61dd8905f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:49.396688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7213-ecfd-4658-beb3-aae61dd8905f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:49.396962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7213-ecfd-4658-beb3-aae61dd8905f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:49.397252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7213-ecfd-4658-beb3-aae61dd8905f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:49.398941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4d0c7213-ecfd-4658-beb3-aae61dd8905f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:49.477399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:49.512500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c7213-ecfd-4658-beb3-aae61dd8905f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:49.514082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c7213-ecfd-4658-beb3-aae61dd8905f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:49.532619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 751/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:51.735160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae3c3-cdfb-43cd-b172-4cc152be498a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:51.735737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae3c3-cdfb-43cd-b172-4cc152be498a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:51.735737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ae3c3-cdfb-43cd-b172-4cc152be498a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:51.736925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 734/1485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:51.742483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df55fed-b3b9-4a28-abde-1ed326c3089d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:51.742959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df55fed-b3b9-4a28-abde-1ed326c3089d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:51.743055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df55fed-b3b9-4a28-abde-1ed326c3089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:51.812889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5df55fed-b3b9-4a28-abde-1ed326c3089d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:51.814175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5df55fed-b3b9-4a28-abde-1ed326c3089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:51.910965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 752/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:52.193236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ae3c3-cdfb-43cd-b172-4cc152be498a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:52.195115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-722ae3c3-cdfb-43cd-b172-4cc152be498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:52.310610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ae3c3-cdfb-43cd-b172-4cc152be498a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:52.386776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:52.388212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663270d-40d4-4653-8827-a9a53918f8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:52.388825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663270d-40d4-4653-8827-a9a53918f8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:52.389108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663270d-40d4-4653-8827-a9a53918f8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:52.389612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663270d-40d4-4653-8827-a9a53918f8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:52.391792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3663270d-40d4-4653-8827-a9a53918f8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:52.507457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663270d-40d4-4653-8827-a9a53918f8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:52.508848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663270d-40d4-4653-8827-a9a53918f8e7 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:52.526814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 735/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:54.791813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912af2-808c-4592-b383-1f50ace9b97c None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.792417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912af2-808c-4592-b383-1f50ace9b97c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.792417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912af2-808c-4592-b383-1f50ace9b97c None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.793685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 753/1488] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:54.800299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3207-ea08-428a-9b24-c34cc853a8a2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.801014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3207-ea08-428a-9b24-c34cc853a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.801192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3207-ea08-428a-9b24-c34cc853a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.873942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-072c3207-ea08-428a-9b24-c34cc853a8a2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:54.875079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-072c3207-ea08-428a-9b24-c34cc853a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:54.929832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:54.974093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 736/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:55.276796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912af2-808c-4592-b383-1f50ace9b97c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:55.278420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1b912af2-808c-4592-b383-1f50ace9b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:55.321017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:55.393751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912af2-808c-4592-b383-1f50ace9b97c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:55.479822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781789b-2e25-4764-8550-6763f516f64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:55.480675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781789b-2e25-4764-8550-6763f516f64e service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:55.480952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781789b-2e25-4764-8550-6763f516f64e service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:55.481204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781789b-2e25-4764-8550-6763f516f64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:55.483723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0781789b-2e25-4764-8550-6763f516f64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:55.572034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:55.609214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781789b-2e25-4764-8550-6763f516f64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:55.610687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781789b-2e25-4764-8550-6763f516f64e service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:55.631406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 754/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:30:57.949368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b65ae-091d-4061-82ab-26e492891741 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.950345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b65ae-091d-4061-82ab-26e492891741 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.950345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b65ae-091d-4061-82ab-26e492891741 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:57.952453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 737/1491] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 30 09:30:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:57.958910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98d48-7497-4bb4-90f4-8472c5e5cd6c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.959361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98d48-7497-4bb4-90f4-8472c5e5cd6c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.959471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98d48-7497-4bb4-90f4-8472c5e5cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.031050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-88b98d48-7497-4bb4-90f4-8472c5e5cd6c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:58.032258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-88b98d48-7497-4bb4-90f4-8472c5e5cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:58.134926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 755/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:30:58.425500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b65ae-091d-4061-82ab-26e492891741 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:58.427977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ed5b65ae-091d-4061-82ab-26e492891741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:58.544619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b65ae-091d-4061-82ab-26e492891741 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:58.627745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c1cd-3018-4be2-96b9-28874b6cd43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:58.628357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c1cd-3018-4be2-96b9-28874b6cd43c service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:58.628628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c1cd-3018-4be2-96b9-28874b6cd43c service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:58.628885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c1cd-3018-4be2-96b9-28874b6cd43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.630951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-61c4c1cd-3018-4be2-96b9-28874b6cd43c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:58.641846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:58.760276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4c1cd-3018-4be2-96b9-28874b6cd43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:58.761627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4c1cd-3018-4be2-96b9-28874b6cd43c service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:58.780593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 738/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:31:08.133355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=82 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:08.778192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=50 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:12.697895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:12.698508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:12.698508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:12.780735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:12.781989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:12.881527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 756/1494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:12.893046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e60b3-1c69-4776-b2cb-f67eaeff1262 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:12.893581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e60b3-1c69-4776-b2cb-f67eaeff1262 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:12.893581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e60b3-1c69-4776-b2cb-f67eaeff1262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:12.971127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2a2e60b3-1c69-4776-b2cb-f67eaeff1262 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:12.972332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2a2e60b3-1c69-4776-b2cb-f67eaeff1262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:13.072746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 739/1495] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:13.079262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:13.080473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:13.092768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37358c1-19b5-45c7-8969-7ce401d5fbc9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:13.166540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:13.202914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:13.203530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:13.203801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:13.204071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:13.204691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:32:13.204986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:13.206102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:13.206102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:32:13.206102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:32:13.206999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:13.218820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 757/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:32:13.227512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e60b3-1c69-4776-b2cb-f67eaeff1262 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:13.237351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e60b3-1c69-4776-b2cb-f67eaeff1262 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:13.305049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:13.341829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:13.342464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:13.342756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:13.343002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:13.343629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:13.345400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING py.warnings [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:13.345400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: warnings.warn(msg) Sep 30 09:32:13.345400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: Sep 30 09:32:13.346649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:13.407141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 740/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:32:13 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:32:13.412119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:13.413659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:13.448663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce37937-3709-44f9-b108-6e2bc93be8f1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:13.549447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:13.550069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:13.550339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:13.550601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:13.551220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:13.552261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:13.552261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:32:13.552261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:32:13.553675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:13.597787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 758/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:32:13 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:32:13.602319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:13.603845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:13.670491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454be5-d299-4c24-bbb3-234b1e315941 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:13.757482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:13.771921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:13.772781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:13.773105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:13.773418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:13.774385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:13.775896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING py.warnings [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:13.775896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: warnings.warn(msg) Sep 30 09:32:13.775896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: Sep 30 09:32:13.777104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:13.792804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 741/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:32:13.797123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:13.798736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:13.810434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716021-561d-482e-8df5-387795bcbc54 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:13.836726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:13.914373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a723b-55ce-42cc-99f7-74256350d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:13.914995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a723b-55ce-42cc-99f7-74256350d3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:13.915270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a723b-55ce-42cc-99f7-74256350d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:13.915537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a723b-55ce-42cc-99f7-74256350d3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:13.916176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a723b-55ce-42cc-99f7-74256350d3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:13.917196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-797a723b-55ce-42cc-99f7-74256350d3c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:13.917196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:32:13.917196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:32:13.918145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a723b-55ce-42cc-99f7-74256350d3c7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:13.930986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 759/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:32:13.935500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:13.937044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:13.973123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920553f2-3db3-429f-89ca-43501b788756 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:14.077434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943a953-2c2e-428b-8bd3-809653078b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:14.078098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943a953-2c2e-428b-8bd3-809653078b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:14.078373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943a953-2c2e-428b-8bd3-809653078b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:14.078640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943a953-2c2e-428b-8bd3-809653078b42 admin admin] PATH_INFO: `/v3/projects/7edb74f076454abc91d3b0a0fd5beeed/users/ae93b22668594efba74c50cb78e39d31/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:14.115112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943a953-2c2e-428b-8bd3-809653078b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edb74f076454abc91d3b0a0fd5beeed, user_id=ae93b22668594efba74c50cb78e39d31, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:14.116164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING py.warnings [None req-0943a953-2c2e-428b-8bd3-809653078b42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:14.116164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: warnings.warn(msg) Sep 30 09:32:14.116164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: Sep 30 09:32:14.118147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943a953-2c2e-428b-8bd3-809653078b42 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:14.149214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 742/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:32:13 2022] PUT /identity/v3/projects/7edb74f076454abc91d3b0a0fd5beeed/users/ae93b22668594efba74c50cb78e39d31/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:32:14.162445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e19cff-4501-4961-90ad-7edfb1829cc1 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:14.162734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e19cff-4501-4961-90ad-7edfb1829cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:14.162987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e19cff-4501-4961-90ad-7edfb1829cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:14.225332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-20e19cff-4501-4961-90ad-7edfb1829cc1 None None] MFA Rules not processed for user `ae93b22668594efba74c50cb78e39d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:14.226626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-20e19cff-4501-4961-90ad-7edfb1829cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:14.304895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 760/1502] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:14.319075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208439f-dc1f-4002-93a9-efa077730853 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:14.319353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208439f-dc1f-4002-93a9-efa077730853 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:14.319623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208439f-dc1f-4002-93a9-efa077730853 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:14.320959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 743/1503] 10.222.0.20 () {54 vars in 963 bytes} [Fri Sep 30 09:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:14.327800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12f63-01f6-4cb7-ac11-48b6d21e4ecf None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:14.328031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12f63-01f6-4cb7-ac11-48b6d21e4ecf None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:14.328347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12f63-01f6-4cb7-ac11-48b6d21e4ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:14.362536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:14.410773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d2b12f63-01f6-4cb7-ac11-48b6d21e4ecf None None] MFA Rules not processed for user `b7c18108a06141b5b501241b919663bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:14.412227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d2b12f63-01f6-4cb7-ac11-48b6d21e4ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:14.488624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 761/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Fri Sep 30 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:14.497054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208439f-dc1f-4002-93a9-efa077730853 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:14.499396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e208439f-dc1f-4002-93a9-efa077730853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:14.554851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:14.612857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208439f-dc1f-4002-93a9-efa077730853 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:14.696381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7c18108a06141b5b501241b919663bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:14.696996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:14.697265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:14.697533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:14.699170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:14.807387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:14.809905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:14.815526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:14.830736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 744/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:14.878321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377a0da-0644-4b50-841d-5b5f615b76a7 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:14.878793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377a0da-0644-4b50-841d-5b5f615b76a7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:14.878899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377a0da-0644-4b50-841d-5b5f615b76a7 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:14.880751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 762/1506] 10.222.0.20 () {52 vars in 830 bytes} [Fri Sep 30 09:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:14.884690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:14.885942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:14.987471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1b61-7944-4e76-a653-4dce55df33cb service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:15.092744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:15.093375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:15.093653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:15.093951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] PATH_INFO: `/v3/users/ae93b22668594efba74c50cb78e39d31` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:15.109054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae93b22668594efba74c50cb78e39d31)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:15.110146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING py.warnings [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:15.110146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: warnings.warn(msg) Sep 30 09:32:15.110146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: Sep 30 09:32:15.111374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:15.121974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:15.181576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae93b22668594efba74c50cb78e39d31'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:15.195450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae93b22668594efba74c50cb78e39d31'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:15.195993 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae93b22668594efba74c50cb78e39d31'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:15.196402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae93b22668594efba74c50cb78e39d31'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:15.219739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae93b22668594efba74c50cb78e39d31'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:15.237136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 745/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:32:14 2022] DELETE /identity/v3/users/ae93b22668594efba74c50cb78e39d31 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:32:15.241993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:15.242279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:15.242551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:15.302297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:15.303521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:15.386170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:15.399323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 763/1508] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:15.409714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:15.411007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:15.515307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052074-a445-4325-a554-210002a9c372 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:15.579265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:15.602297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07d5ef-d9e3-4244-a776-f5ab2364e972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:15.602940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d5ef-d9e3-4244-a776-f5ab2364e972 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:15.603214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d5ef-d9e3-4244-a776-f5ab2364e972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:15.603482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d5ef-d9e3-4244-a776-f5ab2364e972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:15.605123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9c07d5ef-d9e3-4244-a776-f5ab2364e972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:15.723754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07d5ef-d9e3-4244-a776-f5ab2364e972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:15.725160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07d5ef-d9e3-4244-a776-f5ab2364e972 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:15.744696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 746/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:16.107547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:16.108864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:16.121531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81724dc5-9064-4b26-81e4-5592e0eba7ce None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:16.222275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:16.222903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:16.223154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:16.223415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] PATH_INFO: `/v3/projects/7edb74f076454abc91d3b0a0fd5beeed` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:16.234985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7edb74f076454abc91d3b0a0fd5beeed)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:16.236468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:32:16.236468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:32:16.236468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:32:16.237881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:16.304501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7edb74f076454abc91d3b0a0fd5beeed', 'request_id': 'req-209b18c5-6bdb-4f50-81b7-128192357a27'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:16.311159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7edb74f076454abc91d3b0a0fd5beeed', 'request_id': 'req-209b18c5-6bdb-4f50-81b7-128192357a27'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:16.320755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7edb74f076454abc91d3b0a0fd5beeed', 'request_id': 'req-209b18c5-6bdb-4f50-81b7-128192357a27'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:16.356689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] The token cache is being invalidate because project 7edb74f076454abc91d3b0a0fd5beeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:32:16.356984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:16.357423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-209b18c5-6bdb-4f50-81b7-128192357a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:32:16.358869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 764/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:32:16 2022] DELETE /identity/v3/projects/7edb74f076454abc91d3b0a0fd5beeed => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:32:25.742388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=62 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:26.354480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:30.239290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c68d-205a-452c-9a16-dc3a61425764 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:30.240018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c68d-205a-452c-9a16-dc3a61425764 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:30.240018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c68d-205a-452c-9a16-dc3a61425764 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:30.242078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:33:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:30.247631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405db3-84d2-4fda-9e06-7cb83a219c79 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:30.248104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405db3-84d2-4fda-9e06-7cb83a219c79 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:30.248209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405db3-84d2-4fda-9e06-7cb83a219c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:30.343248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-94405db3-84d2-4fda-9e06-7cb83a219c79 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:30.344487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-94405db3-84d2-4fda-9e06-7cb83a219c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:30.453326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:30.610229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c68d-205a-452c-9a16-dc3a61425764 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:30.612862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23d3c68d-205a-452c-9a16-dc3a61425764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:30.745746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c68d-205a-452c-9a16-dc3a61425764 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:30.752626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf746ac-f429-43db-98d0-751f70c317b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:30.753230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf746ac-f429-43db-98d0-751f70c317b9 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:30.753513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf746ac-f429-43db-98d0-751f70c317b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:30.753781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf746ac-f429-43db-98d0-751f70c317b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:30.762567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf746ac-f429-43db-98d0-751f70c317b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:30.764167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf746ac-f429-43db-98d0-751f70c317b9 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:30.773897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 748/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:31.863103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8b6b-e376-434e-b510-e90d5c796c4f None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.863967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8b6b-e376-434e-b510-e90d5c796c4f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.863967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8b6b-e376-434e-b510-e90d5c796c4f None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.866083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:33:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:31.872708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8118cf-26d3-4089-99fa-7346240d1a05 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.873189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8118cf-26d3-4089-99fa-7346240d1a05 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.873189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8118cf-26d3-4089-99fa-7346240d1a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.893671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ff8118cf-26d3-4089-99fa-7346240d1a05 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:31.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ff8118cf-26d3-4089-99fa-7346240d1a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:31.903374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:32.056798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8b6b-e376-434e-b510-e90d5c796c4f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:32.076831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8b6b-e376-434e-b510-e90d5c796c4f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:32.082780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00919f7-e306-4402-b291-a92497234b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:32.083384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00919f7-e306-4402-b291-a92497234b89 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:32.083665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00919f7-e306-4402-b291-a92497234b89 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:32.083935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00919f7-e306-4402-b291-a92497234b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:32.093005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00919f7-e306-4402-b291-a92497234b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:32.094644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00919f7-e306-4402-b291-a92497234b89 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:32.104758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 767/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:36.780747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab2b9-8877-4adf-8d01-3b93479bf385 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:36.781344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab2b9-8877-4adf-8d01-3b93479bf385 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:36.781344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab2b9-8877-4adf-8d01-3b93479bf385 None None] PATH_INFO: `/v3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:36.782661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 750/1517] 10.222.0.23 () {54 vars in 925 bytes} [Fri Sep 30 09:33:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:33:36.790273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176d99d-3cd3-4a4a-bcbf-523db71f00a1 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:36.790722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176d99d-3cd3-4a4a-bcbf-523db71f00a1 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:36.790818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176d99d-3cd3-4a4a-bcbf-523db71f00a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:36.854912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5176d99d-3cd3-4a4a-bcbf-523db71f00a1 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:36.856141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5176d99d-3cd3-4a4a-bcbf-523db71f00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:36.875046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:36.934706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 768/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Sep 30 09:33:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:41.888540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=56 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:43.607427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50721-9cf3-4975-a0dc-8366d2b7d6e2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.608144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50721-9cf3-4975-a0dc-8366d2b7d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.608144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50721-9cf3-4975-a0dc-8366d2b7d6e2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.609312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 751/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:43.616245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565f24-0b11-40ac-8e78-8fb4d6006c70 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.616786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565f24-0b11-40ac-8e78-8fb4d6006c70 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.616786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565f24-0b11-40ac-8e78-8fb4d6006c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.636752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d5565f24-0b11-40ac-8e78-8fb4d6006c70 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:43.638041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d5565f24-0b11-40ac-8e78-8fb4d6006c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:43.646748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 769/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:43.803499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e50721-9cf3-4975-a0dc-8366d2b7d6e2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:43.820747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e50721-9cf3-4975-a0dc-8366d2b7d6e2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:43.826844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a5638-2889-43a1-bb80-c40a67a079d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:43.827565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5638-2889-43a1-bb80-c40a67a079d6 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.827836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5638-2889-43a1-bb80-c40a67a079d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.828094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a5638-2889-43a1-bb80-c40a67a079d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.836567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a5638-2889-43a1-bb80-c40a67a079d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:43.838236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a5638-2889-43a1-bb80-c40a67a079d6 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:43.848442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 752/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:44.929529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdea73-6de1-4d37-8466-3a92ac352f05 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:44.930636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdea73-6de1-4d37-8466-3a92ac352f05 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:44.930636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdea73-6de1-4d37-8466-3a92ac352f05 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:44.932310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:44.941638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7069-1906-4ad2-931e-48484e3941cf None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:44.942172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7069-1906-4ad2-931e-48484e3941cf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:44.942172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7069-1906-4ad2-931e-48484e3941cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:44.968467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8c2d7069-1906-4ad2-931e-48484e3941cf None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:44.969674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8c2d7069-1906-4ad2-931e-48484e3941cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:44.979721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:45.131736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdea73-6de1-4d37-8466-3a92ac352f05 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:45.147524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdea73-6de1-4d37-8466-3a92ac352f05 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:45.153019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050a3c4-54b0-492c-9388-265aa4b287e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:45.153635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a3c4-54b0-492c-9388-265aa4b287e7 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.154364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a3c4-54b0-492c-9388-265aa4b287e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.154636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a3c4-54b0-492c-9388-265aa4b287e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.163783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050a3c4-54b0-492c-9388-265aa4b287e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:45.165605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050a3c4-54b0-492c-9388-265aa4b287e7 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:45.176552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 771/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:45.318261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01869b-a4aa-49a6-95cb-729167c11f00 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.318585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01869b-a4aa-49a6-95cb-729167c11f00 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.318898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01869b-a4aa-49a6-95cb-729167c11f00 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.320207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 754/1525] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 30 09:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:45.326024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45168f60-f67d-49d3-8245-f412995a4388 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.326748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45168f60-f67d-49d3-8245-f412995a4388 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.326748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45168f60-f67d-49d3-8245-f412995a4388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.347514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-45168f60-f67d-49d3-8245-f412995a4388 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:45.348754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-45168f60-f67d-49d3-8245-f412995a4388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:45.358221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 772/1526] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 09:33:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:45.365933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01869b-a4aa-49a6-95cb-729167c11f00 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:45.379809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01869b-a4aa-49a6-95cb-729167c11f00 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:45.384781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1672b-6501-48fb-997a-9812c3d71838 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:45.385374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1672b-6501-48fb-997a-9812c3d71838 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.385644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1672b-6501-48fb-997a-9812c3d71838 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.385941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1672b-6501-48fb-997a-9812c3d71838 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.394206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1672b-6501-48fb-997a-9812c3d71838 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:45.395796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1672b-6501-48fb-997a-9812c3d71838 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:45.405456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 755/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:49.100243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd89f4d-d700-422e-87ee-6b543631756e None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.101207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd89f4d-d700-422e-87ee-6b543631756e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.101207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd89f4d-d700-422e-87ee-6b543631756e None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.103053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:33:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:49.110437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a856eb-d658-4416-a5d8-cfa1423664e0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.110936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a856eb-d658-4416-a5d8-cfa1423664e0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.111033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a856eb-d658-4416-a5d8-cfa1423664e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.134606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d9a856eb-d658-4416-a5d8-cfa1423664e0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:49.136499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d9a856eb-d658-4416-a5d8-cfa1423664e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:49.150191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:49.456502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd89f4d-d700-422e-87ee-6b543631756e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:49.459628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5bd89f4d-d700-422e-87ee-6b543631756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:49.561243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd89f4d-d700-422e-87ee-6b543631756e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:49.565219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4482e7a-0410-4fd6-a2a4-aebe67cd9032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:49.565842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4482e7a-0410-4fd6-a2a4-aebe67cd9032 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.566141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4482e7a-0410-4fd6-a2a4-aebe67cd9032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.566401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4482e7a-0410-4fd6-a2a4-aebe67cd9032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.575872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4482e7a-0410-4fd6-a2a4-aebe67cd9032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:49.577313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4482e7a-0410-4fd6-a2a4-aebe67cd9032 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:49.587042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 774/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:51.717433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d532-87b2-4852-875d-40683077328f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:51.718082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d532-87b2-4852-875d-40683077328f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:51.718082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d532-87b2-4852-875d-40683077328f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:51.720037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:51.726476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91837d05-7896-4848-a2de-c5d8e6039641 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:51.727004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91837d05-7896-4848-a2de-c5d8e6039641 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:51.727139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91837d05-7896-4848-a2de-c5d8e6039641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:51.749007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-91837d05-7896-4848-a2de-c5d8e6039641 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:51.750284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-91837d05-7896-4848-a2de-c5d8e6039641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:51.759695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:52.048332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399d532-87b2-4852-875d-40683077328f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:52.063102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399d532-87b2-4852-875d-40683077328f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:52.066829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520c3a1-78ad-49c1-b4d4-3565663a5289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:52.067430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c3a1-78ad-49c1-b4d4-3565663a5289 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:52.067707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c3a1-78ad-49c1-b4d4-3565663a5289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:52.067978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c3a1-78ad-49c1-b4d4-3565663a5289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:52.078044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520c3a1-78ad-49c1-b4d4-3565663a5289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:52.079492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520c3a1-78ad-49c1-b4d4-3565663a5289 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:52.089128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 758/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:01.743047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=73 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:02.085092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=24 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:07.487300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6129c-93b1-495f-9050-ecf98367f964 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.487927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6129c-93b1-495f-9050-ecf98367f964 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.487927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6129c-93b1-495f-9050-ecf98367f964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.515378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-57d6129c-93b1-495f-9050-ecf98367f964 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:07.516610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-57d6129c-93b1-495f-9050-ecf98367f964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:07.525773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 776/1534] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:07.538001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5108-3045-4a7a-aae7-f270c8d31735 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.538614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5108-3045-4a7a-aae7-f270c8d31735 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.538614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5108-3045-4a7a-aae7-f270c8d31735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.538836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0cbe-ba9f-4265-83c6-ffdab17e0ac9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.539054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0cbe-ba9f-4265-83c6-ffdab17e0ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.539329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf0cbe-ba9f-4265-83c6-ffdab17e0ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.570878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-af1a5108-3045-4a7a-aae7-f270c8d31735 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:07.572300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af1a5108-3045-4a7a-aae7-f270c8d31735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:07.574678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2fcf0cbe-ba9f-4265-83c6-ffdab17e0ac9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:07.575898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2fcf0cbe-ba9f-4265-83c6-ffdab17e0ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:07.581344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 759/1535] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:07.592686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 777/1536] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:07.597906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf0cbe-ba9f-4265-83c6-ffdab17e0ac9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:07.598135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75178a2e-1567-4717-9c68-22ad61ad826f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.598347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75178a2e-1567-4717-9c68-22ad61ad826f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.598616 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75178a2e-1567-4717-9c68-22ad61ad826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.611669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf0cbe-ba9f-4265-83c6-ffdab17e0ac9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:07.632951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:07.633622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.633927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.634205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.634879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:07.635184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:07.636869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:07.650350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-75178a2e-1567-4717-9c68-22ad61ad826f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:07.651583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-75178a2e-1567-4717-9c68-22ad61ad826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:07.664214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 760/1537] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:07.665844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 778/1538] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:35:07.670918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75178a2e-1567-4717-9c68-22ad61ad826f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:07.675073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:07.696867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecab9-2f10-45f2-87a6-9aa88528c333 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:07.701654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75178a2e-1567-4717-9c68-22ad61ad826f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:07.711486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:07.712222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.712503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.712776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.713619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:07.715071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:07.715071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:35:07.715071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:35:07.716426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:07.717643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:07.718331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.718604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.721974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.722718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:07.723022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:07.724518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING py.warnings [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:07.724518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: warnings.warn(msg) Sep 30 09:35:07.724518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: Sep 30 09:35:07.726963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e0a0b-854a-4310-b3d9-7afa05e17956 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:07.753237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 761/1539] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:07.761413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b040-d03d-40ab-a81f-17832bad2511 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.761755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b040-d03d-40ab-a81f-17832bad2511 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.761991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b040-d03d-40ab-a81f-17832bad2511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.804029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 779/1540] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:07.804695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:07.807096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4992b040-d03d-40ab-a81f-17832bad2511 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:07.809543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4992b040-d03d-40ab-a81f-17832bad2511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:07.937225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aaf5dc-3e65-4211-a981-0bf3a40f04be admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:07.939495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 762/1541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:07.940976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42f91b-bbd2-48de-95e7-2c5bee128ff0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.941471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42f91b-bbd2-48de-95e7-2c5bee128ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.941965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42f91b-bbd2-48de-95e7-2c5bee128ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.948596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bb7c1-3b38-4b01-a818-d8546737f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:07.949637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bb7c1-3b38-4b01-a818-d8546737f18f admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.950305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bb7c1-3b38-4b01-a818-d8546737f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.950404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bb7c1-3b38-4b01-a818-d8546737f18f admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.951040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bb7c1-3b38-4b01-a818-d8546737f18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:07.953512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bb7c1-3b38-4b01-a818-d8546737f18f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:07.966033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ef42f91b-bbd2-48de-95e7-2c5bee128ff0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:07.967673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ef42f91b-bbd2-48de-95e7-2c5bee128ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:07.978353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 763/1542] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:07.979216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42f91b-bbd2-48de-95e7-2c5bee128ff0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:07.989199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42f91b-bbd2-48de-95e7-2c5bee128ff0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:07.997044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6310687-afa2-4d82-84b0-4812dce886fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:07.997210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 780/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:07.997295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310687-afa2-4d82-84b0-4812dce886fb admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.997295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310687-afa2-4d82-84b0-4812dce886fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.997295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310687-afa2-4d82-84b0-4812dce886fb admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.997476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c4505-b737-45e8-9f67-522892258b62 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:07.997543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6310687-afa2-4d82-84b0-4812dce886fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:07.997609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c4505-b737-45e8-9f67-522892258b62 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:07.997609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c4505-b737-45e8-9f67-522892258b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:07.997909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING py.warnings [None req-f6310687-afa2-4d82-84b0-4812dce886fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:07.997909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: warnings.warn(msg) Sep 30 09:35:07.997909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: Sep 30 09:35:07.999232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6310687-afa2-4d82-84b0-4812dce886fb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.022651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-861c4505-b737-45e8-9f67-522892258b62 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.024317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-861c4505-b737-45e8-9f67-522892258b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.027893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 764/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.029199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d54f-b0f1-4930-8b26-02899296b88b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.029606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d54f-b0f1-4930-8b26-02899296b88b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.029741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d54f-b0f1-4930-8b26-02899296b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.049824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b785d54f-b0f1-4930-8b26-02899296b88b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.051021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b785d54f-b0f1-4930-8b26-02899296b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.090253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 781/1545] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.091692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdf1eb-c4e4-425a-9d24-1b46cf998b45 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.091952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdf1eb-c4e4-425a-9d24-1b46cf998b45 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.092219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdf1eb-c4e4-425a-9d24-1b46cf998b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.112579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7fbdf1eb-c4e4-425a-9d24-1b46cf998b45 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.113814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7fbdf1eb-c4e4-425a-9d24-1b46cf998b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.114216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 765/1546] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.115452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4f11d-9e99-46d0-810f-2f2476661f68 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.115729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4f11d-9e99-46d0-810f-2f2476661f68 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.115988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4f11d-9e99-46d0-810f-2f2476661f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.128084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 782/1547] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.129519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf4cb9-d9d0-4feb-bac5-f5496287d396 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.129820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf4cb9-d9d0-4feb-bac5-f5496287d396 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.130105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf4cb9-d9d0-4feb-bac5-f5496287d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.141716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6ca4f11d-9e99-46d0-810f-2f2476661f68 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.142953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6ca4f11d-9e99-46d0-810f-2f2476661f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.149781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6ecf4cb9-d9d0-4feb-bac5-f5496287d396 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.151010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6ecf4cb9-d9d0-4feb-bac5-f5496287d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.151131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 766/1548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.154977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4f11d-9e99-46d0-810f-2f2476661f68 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.160278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 783/1549] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.161558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f448204-6bd8-4b78-86aa-67b441490278 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.161871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f448204-6bd8-4b78-86aa-67b441490278 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.162147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f448204-6bd8-4b78-86aa-67b441490278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.162245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4f11d-9e99-46d0-810f-2f2476661f68 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.167044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c3dd-2032-4f7b-9f68-057f701c4298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.167635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c3dd-2032-4f7b-9f68-057f701c4298 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.167912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c3dd-2032-4f7b-9f68-057f701c4298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.168195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c3dd-2032-4f7b-9f68-057f701c4298 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.168808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8c3dd-2032-4f7b-9f68-057f701c4298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.171099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8c3dd-2032-4f7b-9f68-057f701c4298 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.181438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7f448204-6bd8-4b78-86aa-67b441490278 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.182833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7f448204-6bd8-4b78-86aa-67b441490278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.192353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 784/1550] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.193268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f448204-6bd8-4b78-86aa-67b441490278 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.195802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 767/1551] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.197236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67775f-6a94-4b3d-8515-f0446f0795b7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.197752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67775f-6a94-4b3d-8515-f0446f0795b7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.198333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67775f-6a94-4b3d-8515-f0446f0795b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.204921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f448204-6bd8-4b78-86aa-67b441490278 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.209897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769da16f-79b3-409f-a473-bb4eaf67ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.210504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769da16f-79b3-409f-a473-bb4eaf67ec72 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.210781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769da16f-79b3-409f-a473-bb4eaf67ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.211050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769da16f-79b3-409f-a473-bb4eaf67ec72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.211691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769da16f-79b3-409f-a473-bb4eaf67ec72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.213289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769da16f-79b3-409f-a473-bb4eaf67ec72 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.215661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:08.219880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2a67775f-6a94-4b3d-8515-f0446f0795b7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.221164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2a67775f-6a94-4b3d-8515-f0446f0795b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.225273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 785/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:08.226606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49cbab-147b-42b5-9134-95c696b68759 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.226887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49cbab-147b-42b5-9134-95c696b68759 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.227170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49cbab-147b-42b5-9134-95c696b68759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.229646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 768/1553] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.230902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dad07-16b7-4759-8868-cfc49f73f633 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.231175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dad07-16b7-4759-8868-cfc49f73f633 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.231437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dad07-16b7-4759-8868-cfc49f73f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.247549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0e49cbab-147b-42b5-9134-95c696b68759 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.249092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0e49cbab-147b-42b5-9134-95c696b68759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.250259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f36dad07-16b7-4759-8868-cfc49f73f633 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.251401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f36dad07-16b7-4759-8868-cfc49f73f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.257045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 786/1554] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.257843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49cbab-147b-42b5-9134-95c696b68759 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.263007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 769/1555] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.264311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dad07-16b7-4759-8868-cfc49f73f633 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.267167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49cbab-147b-42b5-9134-95c696b68759 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.272161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.272674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.272947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.273216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.273915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:08.274215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.274490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dad07-16b7-4759-8868-cfc49f73f633 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.275834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.279540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7541de1-5dde-4d3e-8d5f-ba5f08f66ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.280125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7541de1-5dde-4d3e-8d5f-ba5f08f66ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.280394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7541de1-5dde-4d3e-8d5f-ba5f08f66ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.280683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7541de1-5dde-4d3e-8d5f-ba5f08f66ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.281315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7541de1-5dde-4d3e-8d5f-ba5f08f66ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:08.281638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7541de1-5dde-4d3e-8d5f-ba5f08f66ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.283638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7541de1-5dde-4d3e-8d5f-ba5f08f66ee3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.290567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 787/1556] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:08.291551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.293239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:08.304566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 770/1557] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:08.304566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde07c-90a3-438b-a15a-1e2196b34a5e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.304566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde07c-90a3-438b-a15a-1e2196b34a5e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.304566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde07c-90a3-438b-a15a-1e2196b34a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.304924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ba892-f64b-4fed-8f1a-58ea239ff08e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.310108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.310985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.311266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.311527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.312187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.313781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.322943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d4dde07c-90a3-438b-a15a-1e2196b34a5e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.324131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d4dde07c-90a3-438b-a15a-1e2196b34a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.325430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 788/1558] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:08.326145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.334427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 771/1559] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.335245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dde07c-90a3-438b-a15a-1e2196b34a5e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.338075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b598-7f5a-4eef-ab90-f6591162bf77 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.342854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.343441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.343735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.343974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.344599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.345147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dde07c-90a3-438b-a15a-1e2196b34a5e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.346302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.349694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.350318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.350577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.350841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.351465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:08.351758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.353343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.356197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 789/1560] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:08.356976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.365383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 772/1561] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:08.366077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.369288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7855ed-d8f8-43b2-ac0a-cca8f6fa172d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.375240 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.375571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0eb0-a809-43d9-8aa0-424344c84705 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.375844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.376113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.376387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.377025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:08.377356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.378966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.380453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.380941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.381227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.381487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.382170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:08.382487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.384069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.391666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 790/1562] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:08.392566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.396770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 773/1563] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:08.402763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.402898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf879-aec2-4d2c-86d2-ffd305853560 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.408749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.409353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.409661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.409962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.410594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.412505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.413305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d5b0f-d897-4709-abce-93cc486e0e25 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.417749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.418416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.419524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.419824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.420459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.422401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.444216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 791/1564] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.445442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.453287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 774/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.455343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.508439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a35a0-4fd5-4485-8d43-d48cc867b5ec admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.520372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aee9-a993-4488-9dd4-bf1a646ff074 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.525056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.525654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.525956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.526219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.526860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:08.527159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.528758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.540515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 775/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:08.541281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.552862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c368be-4cf0-46c5-914e-6798aab16250 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.558920 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.559575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.559911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.560135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] PATH_INFO: `/v3/projects/3c3417a9665d4532bac3fe773e296c97/users/b7de0ef4197c40b4b64dfc0339c19705/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.570806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.571412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.571687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.571962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.572580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.574335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.580150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3417a9665d4532bac3fe773e296c97, user_id=b7de0ef4197c40b4b64dfc0339c19705, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.582864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.587541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 792/1567] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:08.587828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.600658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 776/1568] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:08 2022] PUT /identity/v3/projects/3c3417a9665d4532bac3fe773e296c97/users/b7de0ef4197c40b4b64dfc0339c19705/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:08.601345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.601553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d036-7f0b-4df2-82e3-59594ffd5bd9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.629311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:08.672984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c26ca-d738-4a2d-8e0b-70eb0289706b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.674659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.675289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.675569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.675841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.676476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.677656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.678294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.678439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.678571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.678837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.679456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.681368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.703572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:08.707503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 793/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.708317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.711646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 777/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.713412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.773912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f0a42-aae5-455d-ab9f-98932a156775 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.775484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4b5b6-4a81-42cb-8b50-534c0f6d24ef admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.778604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.779223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.779496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.779766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.780085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.780389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.780677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.780947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.781260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.781903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.782714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.784168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.807845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 778/1571] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.808959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.813506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 794/1572] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.813506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.819736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9915c87-00e1-4eae-8b60-7a38b8a834ce admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.874044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c7fc-0f52-43db-9b5a-c5f43d978939 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.878546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51967d-de49-43a6-add2-8bcff53c9443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.879153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51967d-de49-43a6-add2-8bcff53c9443 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.879425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51967d-de49-43a6-add2-8bcff53c9443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.879581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.879691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51967d-de49-43a6-add2-8bcff53c9443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.880217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.880319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51967d-de49-43a6-add2-8bcff53c9443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.880486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.880747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.881361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.882253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51967d-de49-43a6-add2-8bcff53c9443 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.883716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:08.910961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 779/1573] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.910961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.911214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 795/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:08.912453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ae967-e9ce-4efa-8f71-59f18406308f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.912730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ae967-e9ce-4efa-8f71-59f18406308f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.912992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ae967-e9ce-4efa-8f71-59f18406308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.918839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807190f4-be46-40d1-9397-ed816229a86d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:08.932350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-df3ae967-e9ce-4efa-8f71-59f18406308f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:08.933558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-df3ae967-e9ce-4efa-8f71-59f18406308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:08.948019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:08.979359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:08.980022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:08.980296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:08.980565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] PATH_INFO: `/v3/projects/9c4228d57cfd47279f27b1ba70ca3e9f/users/a2a2b2d68d1a4630bc57f1de01131144/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:08.995000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4228d57cfd47279f27b1ba70ca3e9f, user_id=a2a2b2d68d1a4630bc57f1de01131144, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:08.996009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 796/1575] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:08.996824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ae967-e9ce-4efa-8f71-59f18406308f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:08.997709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.009509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ae967-e9ce-4efa-8f71-59f18406308f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.013222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 780/1576] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:08 2022] PUT /identity/v3/projects/9c4228d57cfd47279f27b1ba70ca3e9f/users/a2a2b2d68d1a4630bc57f1de01131144/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:09.014825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.020030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:09.065410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.066056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.066327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.066592 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.067219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.069137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.080410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07403b-2322-488d-9cd4-a7a09a3698b3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.085581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.086215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.086493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.086750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.087374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.089357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.091387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 797/1577] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:08 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:09.092024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.102261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33180571-d327-4425-9c97-1e881af286e1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.107397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.108001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.108284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.108545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.109168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.111172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.114412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 781/1578] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:09 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:09.114412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.122100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0660e8-3b52-4829-bf9c-f048713ba5ad admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.126917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.127447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.127727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.128003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.128612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.130380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.137009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 798/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:09 2022] POST /identity/v3/users => generated 284 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:09.137009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.143983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 782/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.143983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.148149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be96d8-e322-4b5c-8dc7-c52927c93930 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.151410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5614f9-6304-4814-8bd7-ab89b97cd714 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.152743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.153348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.153621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.153916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.154661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.156038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407346-70e6-4376-8e55-8103702bb235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.156241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.156604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407346-70e6-4376-8e55-8103702bb235 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.156877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407346-70e6-4376-8e55-8103702bb235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.157253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407346-70e6-4376-8e55-8103702bb235 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.158258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6407346-70e6-4376-8e55-8103702bb235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.160145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6407346-70e6-4376-8e55-8103702bb235 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.168584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 799/1581] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.170128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.183446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 783/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:09 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:09.185157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda279ff-3106-494f-9535-106869552a23 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.185545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda279ff-3106-494f-9535-106869552a23 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.185758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda279ff-3106-494f-9535-106869552a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.213705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cda279ff-3106-494f-9535-106869552a23 None None] MFA Rules not processed for user `a2a2b2d68d1a4630bc57f1de01131144`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:09.214716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cda279ff-3106-494f-9535-106869552a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:09.227266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fecaa-d1da-4a11-8f3e-339c660c3524 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.230855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.231462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.231732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.231995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.240985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.242475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.251934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 800/1583] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:09.252725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.261577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4e9b9-4813-469e-8d96-e1e1f32fd010 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.266410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.267081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.267370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.267608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.268545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.270227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.279383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 784/1584] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:09.280711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda279ff-3106-494f-9535-106869552a23 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.281220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 801/1585] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.282790 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.292663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda279ff-3106-494f-9535-106869552a23 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.295372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0621e7-799f-4f3d-93c8-5ebe3f9d5595 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.297309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.297958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.298232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.298498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.299130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.300094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.300703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.300817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.300973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.301243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.302009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.303557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.314246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 785/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.315158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 802/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.315630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.316046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.322122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:09.332010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979f68-cd36-4451-b5f4-3113f1307c4e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.335537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9debee-315d-4172-a981-d11f96f62f68 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.338519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.339165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.339404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.339668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.340462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.341367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.342207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.342479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.342702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.342890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.343648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.345346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.362651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 803/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.362651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.362921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 786/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.362921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.372437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9b3a-18bb-4186-84a7-a2aaf86786f6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.375047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d582dc-22ea-4e7b-9e90-8ad71da0c79a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.378188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.378743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.379019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.379284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.379994 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.380257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.380935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.381268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.381597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.382444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.382558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.383963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.396374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 804/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.400454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.412721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452705fd-b2ec-49ac-b097-cd0c277e287f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.418355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.419027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.419411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 787/1591] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:09 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:09.420627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.423384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.423710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.424553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.426313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.434074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:09.444908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 805/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.445805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.460705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97343ce4-785b-4948-ac35-96fcb36c7ef3 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.507294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1d234-b230-43fe-9913-85209568cf6b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.512728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.513751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.514301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.514884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.515890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.517852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.532139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 788/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.533715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.533851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.534443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.534688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.535001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.535893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.537584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.545728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae390e-337e-415a-bba6-76793ad88e0b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.552467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.553269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.553545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.553932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] PATH_INFO: `/v3/projects/8637199252f442dc855428cbb9b0b1b8/users/662238e056e640468faeb943a6f7fa0a/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.555743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 806/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.556719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.568525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d47192-0186-46a0-b94a-09da5ae8fd86 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.573178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8637199252f442dc855428cbb9b0b1b8, user_id=662238e056e640468faeb943a6f7fa0a, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.574673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.575339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.575624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.575907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] PATH_INFO: `/v3/projects/6116940d1a964738930d52f2e36d6fd0/users/b691bda26f954b579009aae9dd6cb2ed/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.576032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.597624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 789/1595] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:09 2022] PUT /identity/v3/projects/8637199252f442dc855428cbb9b0b1b8/users/662238e056e640468faeb943a6f7fa0a/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:09.597624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.620404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6116940d1a964738930d52f2e36d6fd0, user_id=b691bda26f954b579009aae9dd6cb2ed, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.622023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:09.622023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:35:09.622023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:35:09.625399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.657921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 807/1596] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:09 2022] PUT /identity/v3/projects/6116940d1a964738930d52f2e36d6fd0/users/b691bda26f954b579009aae9dd6cb2ed/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:09.658933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.713250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18762c0-2ebf-44dd-b3bb-248319c7dfc1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.754461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45133f6e-22f4-46ff-bc3f-793a4c0aaacf admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.759750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.760546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.760827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.761096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.761889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.764472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.791024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 808/1597] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:09 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:09.792084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.803154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c07d-2f8b-4d4c-af4d-123fd2c3c5ee admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.806773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.807848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.808300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.808786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.809155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.809836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.810010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.810529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.810876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] PATH_INFO: `/v3/projects/fe49e2176fe24386a5e87a080ceba685/users/3863af4713c74e428db100e920bd84db/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.813127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.826347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 790/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:09.827680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.841141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe49e2176fe24386a5e87a080ceba685, user_id=3863af4713c74e428db100e920bd84db, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.844325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.848208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b90d-4b77-4663-870c-f5b0d5b7a0b3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:09.855011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6b796-c129-492d-9194-43882196de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:09.856206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b796-c129-492d-9194-43882196de78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.856821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b796-c129-492d-9194-43882196de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.857344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b796-c129-492d-9194-43882196de78 admin admin] PATH_INFO: `/v3/projects/19098ab8842b4d0e85ba4d94e10317b7/users/e8a49c104e9440fa848d7cfd59baa6fd/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.863864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 809/1599] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:09 2022] PUT /identity/v3/projects/fe49e2176fe24386a5e87a080ceba685/users/3863af4713c74e428db100e920bd84db/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:09.864574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:09.876605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:09.884415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6b796-c129-492d-9194-43882196de78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19098ab8842b4d0e85ba4d94e10317b7, user_id=e8a49c104e9440fa848d7cfd59baa6fd, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:09.887772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6b796-c129-492d-9194-43882196de78 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:09.900291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:09.911447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 791/1600] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:09 2022] PUT /identity/v3/projects/19098ab8842b4d0e85ba4d94e10317b7/users/e8a49c104e9440fa848d7cfd59baa6fd/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:09.911447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a826f-fc17-4d93-b621-450d42cd613a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:09.911901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a826f-fc17-4d93-b621-450d42cd613a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:09.920983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a826f-fc17-4d93-b621-450d42cd613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:09.937190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-107a826f-fc17-4d93-b621-450d42cd613a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:09.938802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-107a826f-fc17-4d93-b621-450d42cd613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:09.959200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64990f-6964-416d-bdc7-39c38cd8fcdf admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:10.014766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 792/1601] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:10.014766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac2bed-ccf0-4481-9a8f-39f65662af4d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.014766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac2bed-ccf0-4481-9a8f-39f65662af4d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.014766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac2bed-ccf0-4481-9a8f-39f65662af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.033365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:10.034964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.035316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.035651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] PATH_INFO: `/v3/projects/cd8aa66f7b6d447db64002a46bef393a/users/7c242f07981e43c28e280d945631de66/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.052303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9dac2bed-ccf0-4481-9a8f-39f65662af4d None None] MFA Rules not processed for user `b691bda26f954b579009aae9dd6cb2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:10.053812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9dac2bed-ccf0-4481-9a8f-39f65662af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:10.057583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8aa66f7b6d447db64002a46bef393a, user_id=7c242f07981e43c28e280d945631de66, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:10.061575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:10.084397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 810/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:09 2022] PUT /identity/v3/projects/cd8aa66f7b6d447db64002a46bef393a/users/7c242f07981e43c28e280d945631de66/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:10.086993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.154176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 793/1603] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:10.155688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac2bed-ccf0-4481-9a8f-39f65662af4d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.182048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac2bed-ccf0-4481-9a8f-39f65662af4d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:10.188836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce49259-5e7e-4c32-ba0f-e49e3aa4e822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:10.189125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce49259-5e7e-4c32-ba0f-e49e3aa4e822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.189471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce49259-5e7e-4c32-ba0f-e49e3aa4e822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.189740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce49259-5e7e-4c32-ba0f-e49e3aa4e822 admin admin] PATH_INFO: `/v3/projects/dc420303910c49cbba449d5bc6687f0c/users/c16b6986a5314d569c19f820bcfa4270/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.196323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29383362-2e67-4d72-b6c4-f4a56df1ea4c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:10.202475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff39c14-a4e2-46d9-b641-c173c6186d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:10.203158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39c14-a4e2-46d9-b641-c173c6186d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.203435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39c14-a4e2-46d9-b641-c173c6186d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.203704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39c14-a4e2-46d9-b641-c173c6186d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.205110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff39c14-a4e2-46d9-b641-c173c6186d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:10.207641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff39c14-a4e2-46d9-b641-c173c6186d00 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:10.212618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce49259-5e7e-4c32-ba0f-e49e3aa4e822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc420303910c49cbba449d5bc6687f0c, user_id=c16b6986a5314d569c19f820bcfa4270, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:10.216981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce49259-5e7e-4c32-ba0f-e49e3aa4e822 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:10.223306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 811/1604] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:10.223306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e17a1c-ba19-48c0-930b-1c6c9dfd3228 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.223306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e17a1c-ba19-48c0-930b-1c6c9dfd3228 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.223306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e17a1c-ba19-48c0-930b-1c6c9dfd3228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.246243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 794/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:10 2022] PUT /identity/v3/projects/dc420303910c49cbba449d5bc6687f0c/users/c16b6986a5314d569c19f820bcfa4270/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:10.248187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0631d6f-f7d2-4da6-83d4-469232274d56 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.248659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0631d6f-f7d2-4da6-83d4-469232274d56 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.249127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0631d6f-f7d2-4da6-83d4-469232274d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.285786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b7e17a1c-ba19-48c0-930b-1c6c9dfd3228 None None] MFA Rules not processed for user `3863af4713c74e428db100e920bd84db`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:10.294518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b7e17a1c-ba19-48c0-930b-1c6c9dfd3228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:10.298983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b0631d6f-f7d2-4da6-83d4-469232274d56 None None] MFA Rules not processed for user `e8a49c104e9440fa848d7cfd59baa6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:10.301338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b0631d6f-f7d2-4da6-83d4-469232274d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:10.347019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:10.427648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 812/1606] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:10.428819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e17a1c-ba19-48c0-930b-1c6c9dfd3228 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.438261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:10.453542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 795/1607] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:10.456798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa34b7-433c-4fb3-9a25-bed419c909ac None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.457088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa34b7-433c-4fb3-9a25-bed419c909ac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.457360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa34b7-433c-4fb3-9a25-bed419c909ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.502784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-03aa34b7-433c-4fb3-9a25-bed419c909ac None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:10.503985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e17a1c-ba19-48c0-930b-1c6c9dfd3228 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:10.504099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-03aa34b7-433c-4fb3-9a25-bed419c909ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:10.508509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:10.509488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.510034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.510599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.607939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:10.610400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:10.622499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 813/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:10.623503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.632589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 796/1609] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:10.634696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa34b7-433c-4fb3-9a25-bed419c909ac None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.639854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f95bc2-cfcc-4b19-b34e-43b6097bebd6 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:10.652237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b316-7268-4fc0-959a-83f214197cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:10.652785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b316-7268-4fc0-959a-83f214197cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.653058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b316-7268-4fc0-959a-83f214197cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.653321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b316-7268-4fc0-959a-83f214197cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.653997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b316-7268-4fc0-959a-83f214197cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:10.656234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b316-7268-4fc0-959a-83f214197cfe admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:10.660431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa34b7-433c-4fb3-9a25-bed419c909ac None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:10.669934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:10.670972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.671455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.672527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] PATH_INFO: `/v3/projects/f6c4dc3dd144479593044e7911253b6e/users/d7e21edcc8d246c2827c5375d32105a6/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.698026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c4dc3dd144479593044e7911253b6e, user_id=d7e21edcc8d246c2827c5375d32105a6, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:10.701209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:10.709417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 814/1610] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:10.709417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.709417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.709417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.723891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 797/1611] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:10 2022] PUT /identity/v3/projects/f6c4dc3dd144479593044e7911253b6e/users/d7e21edcc8d246c2827c5375d32105a6/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:10.724978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.777166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] MFA Rules not processed for user `c16b6986a5314d569c19f820bcfa4270`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:10.778416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:10.835396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af78b6-3b3a-4276-b494-de59fc7fa35a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:10.845238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:10.845966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:10.846287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:10.846646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:10.847534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:10.852106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:10.859421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:10.899237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 798/1612] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:10.900098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.926570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 815/1613] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:10.926570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:10.929328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:10.986430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:10.992153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2b97-27c7-4229-9ac7-403b16166cc2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.001400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.003548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.004222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.004801 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.006080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.010858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.055386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635eae-bc8c-47b2-a2c4-04049db1438d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.061194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 799/1614] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:10 2022] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:11.062632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.129250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.132564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.132934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.133277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.144775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.146179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.170596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 816/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:11.174055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.181192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa297-8b34-4463-b7a1-4f7fb218429a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.188035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.188514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.188854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.189669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.189875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.191975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.195160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e45941-15c8-40e7-8e7d-7580ba953918 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.208286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.209849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.211151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.211874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.214786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.219884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.233087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 800/1616] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:11 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:11.234043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.252236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 817/1617] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:11.254721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1fa0-e1d1-42c6-b473-37e2d233c118 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.255624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.269024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.270009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.270439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.270835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.271652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.274522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.305827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e072-82f0-457a-870e-e717cace1ca4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.317247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.318157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.318434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.318750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.319814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.323040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.329316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 801/1618] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:11 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:11.330298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.354563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01146f36-aa9f-43d9-812e-7b310e40f7ef admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.361560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.362722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.363084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.364026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.364859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.367675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.379480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 818/1619] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:11 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:11.383780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.419434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 802/1620] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:11 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:11.419754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.438624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bd1f9-22d5-49ad-a669-d2d32f842b5b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.529817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.530623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.531653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.532046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] PATH_INFO: `/v3/projects/f6c4dc3dd144479593044e7911253b6e/users/d7e21edcc8d246c2827c5375d32105a6/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.536427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c4dc3dd144479593044e7911253b6e, user_id=d7e21edcc8d246c2827c5375d32105a6, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.540553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.554452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f988-38fc-49d8-ae6d-1d9e9b5436d1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.556198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 803/1621] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:11 2022] PUT /identity/v3/projects/f6c4dc3dd144479593044e7911253b6e/users/d7e21edcc8d246c2827c5375d32105a6/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:11.572085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:11.573655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.656317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:11.699130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.699843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.700203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.700478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.701437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.703420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.724206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 819/1622] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:11.725062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.736578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1656c-f7d1-46af-b4ad-542cdb6ed9d7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.750335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.751807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.752144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.752415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.754865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.758598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.778380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c524c4-793d-4217-94d2-0b0077846481 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.790407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 804/1623] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:11.791730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.803884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.806737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.807021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.808074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.808857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7725-cfb1-4bd0-9343-1824c400d6ab admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.808964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.813786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.820417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8cdd4-e0b7-4d04-8b5f-635d95700b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.822003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8cdd4-e0b7-4d04-8b5f-635d95700b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.822302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8cdd4-e0b7-4d04-8b5f-635d95700b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.822633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8cdd4-e0b7-4d04-8b5f-635d95700b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.823610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8cdd4-e0b7-4d04-8b5f-635d95700b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.825365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8cdd4-e0b7-4d04-8b5f-635d95700b49 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.842392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 805/1624] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:11.844037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4d2b-f8c3-4dad-a781-870ae9b1ac3d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.844388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4d2b-f8c3-4dad-a781-870ae9b1ac3d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.844755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4d2b-f8c3-4dad-a781-870ae9b1ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.855689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 820/1625] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:11 2022] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:11.856652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.876851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971386-7ba2-47f9-a408-a4e135af746a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.883591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.884227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.884500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.884765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.885557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.887341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.900228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dbff4d2b-f8c3-4dad-a781-870ae9b1ac3d None None] MFA Rules not processed for user `d7e21edcc8d246c2827c5375d32105a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:11.903417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 821/1626] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:11.903417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:11.903605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dbff4d2b-f8c3-4dad-a781-870ae9b1ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:11.913775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829565b9-c51e-48ff-b933-e99e61b0a2ad admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:11.921047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:11.921627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:11.921985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:11.922258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] PATH_INFO: `/v3/projects/6e6774ab11b440cc916591035095cd80/users/0e78a986ff764c1f956c1d8de9c7273b/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:11.941043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6774ab11b440cc916591035095cd80, user_id=0e78a986ff764c1f956c1d8de9c7273b, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:11.943882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:11.963653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 822/1627] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:11 2022] PUT /identity/v3/projects/6e6774ab11b440cc916591035095cd80/users/0e78a986ff764c1f956c1d8de9c7273b/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:11.963653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.064202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 806/1628] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:12.065386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4d2b-f8c3-4dad-a781-870ae9b1ac3d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.085747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4d2b-f8c3-4dad-a781-870ae9b1ac3d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.099827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b202d-6d18-439b-a8a3-6303f4f9493e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.101292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.101965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.102246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.102738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.103388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.105013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.108375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.109392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.110114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.115840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] PATH_INFO: `/v3/projects/f30c363278b74b7c8bfa10ee54a7f9e4/users/dfaae91aea1c48f598ac917ce3fdb442/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.119887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 807/1629] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:12.120952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.142758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30c363278b74b7c8bfa10ee54a7f9e4, user_id=dfaae91aea1c48f598ac917ce3fdb442, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.145543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.146128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74000d-c7a7-44c1-b4bd-943161238e7e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.150972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.151647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.151922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.152188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] PATH_INFO: `/v3/projects/3b4fd059282b4034975c23488432a837/users/f1c981a752554cf6968581ca81e7b75c/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.169255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 823/1630] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:11 2022] PUT /identity/v3/projects/f30c363278b74b7c8bfa10ee54a7f9e4/users/dfaae91aea1c48f598ac917ce3fdb442/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:12.170028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.175733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4fd059282b4034975c23488432a837, user_id=f1c981a752554cf6968581ca81e7b75c, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.179587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.211585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 808/1631] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:12 2022] PUT /identity/v3/projects/3b4fd059282b4034975c23488432a837/users/f1c981a752554cf6968581ca81e7b75c/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:12.213019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.233900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:12.274133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64222745-a5fa-4315-a0a3-1ddcc89fad18 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.309723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bc037-be82-473e-b0a9-c0e9deede435 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.315702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.316460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.316795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.317122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.343993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.344624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.344898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.345215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.346182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.349238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.361328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:12.375641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 824/1632] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:12.377623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.393539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ae603-c4da-48c7-98a3-92cd1ebc1045 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.404308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.405649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.407104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.408407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] PATH_INFO: `/v3/projects/6df2026a6c78460ca288a3414f5446b1/users/147e038ac7094784a0e33b130ce019d7/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.409239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.410946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.432456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df2026a6c78460ca288a3414f5446b1, user_id=147e038ac7094784a0e33b130ce019d7, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.433735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 809/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:12.434853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.448809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.449567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7f35-021d-46dd-93fd-fe31fd61429d service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.456658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e7f5f-2726-4584-8adf-0d594d2fb228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.457587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e7f5f-2726-4584-8adf-0d594d2fb228 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.458194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e7f5f-2726-4584-8adf-0d594d2fb228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.459055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e7f5f-2726-4584-8adf-0d594d2fb228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.460343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e7f5f-2726-4584-8adf-0d594d2fb228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.463016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e7f5f-2726-4584-8adf-0d594d2fb228 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.478942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 810/1634] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:12.480861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e45a-b1db-489f-8398-d54bbb4074bd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.481363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e45a-b1db-489f-8398-d54bbb4074bd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.481909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e45a-b1db-489f-8398-d54bbb4074bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.491206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 825/1635] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:12 2022] PUT /identity/v3/projects/6df2026a6c78460ca288a3414f5446b1/users/147e038ac7094784a0e33b130ce019d7/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:12.493112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.520091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c648e45a-b1db-489f-8398-d54bbb4074bd None None] MFA Rules not processed for user `f1c981a752554cf6968581ca81e7b75c`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:12.521966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c648e45a-b1db-489f-8398-d54bbb4074bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:12.641828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 811/1636] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:12.646056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e45a-b1db-489f-8398-d54bbb4074bd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.663454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e45a-b1db-489f-8398-d54bbb4074bd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.670184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507008a5-454a-40c4-b25e-24b991195272 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.681986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.684898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.685976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.686433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.686849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] PATH_INFO: `/v3/projects/f30c363278b74b7c8bfa10ee54a7f9e4/users/dfaae91aea1c48f598ac917ce3fdb442/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.688213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.688853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.689450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] PATH_INFO: `/v3/projects/6e6774ab11b440cc916591035095cd80/users/0e78a986ff764c1f956c1d8de9c7273b/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.692712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30c363278b74b7c8bfa10ee54a7f9e4, user_id=dfaae91aea1c48f598ac917ce3fdb442, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.694116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6774ab11b440cc916591035095cd80, user_id=0e78a986ff764c1f956c1d8de9c7273b, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.698987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.707613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.724322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 812/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:12 2022] PUT /identity/v3/projects/f30c363278b74b7c8bfa10ee54a7f9e4/users/dfaae91aea1c48f598ac917ce3fdb442/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:12.725209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.747596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 826/1638] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:12 2022] PUT /identity/v3/projects/6e6774ab11b440cc916591035095cd80/users/0e78a986ff764c1f956c1d8de9c7273b/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:12.748940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:12.863983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec80ae-62c0-4f10-bf66-6f46ba0986ac admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.874308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:12.889772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee1db9-7fde-4683-81bc-588122d37395 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:12.903672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc21f9-8046-4628-a482-598399acc6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.904392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc21f9-8046-4628-a482-598399acc6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.904837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc21f9-8046-4628-a482-598399acc6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.905108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc21f9-8046-4628-a482-598399acc6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.906416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc21f9-8046-4628-a482-598399acc6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:12.908725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc21f9-8046-4628-a482-598399acc6a3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:12.930022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:12.962947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 827/1639] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:12 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:12.964273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691507c-0894-4c2a-be26-0e39776d294d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.964544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691507c-0894-4c2a-be26-0e39776d294d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.964818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691507c-0894-4c2a-be26-0e39776d294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.997147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401370e-c673-4a28-a3b2-31776a0c3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:12.997825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401370e-c673-4a28-a3b2-31776a0c3580 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:12.998127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401370e-c673-4a28-a3b2-31776a0c3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:12.998397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401370e-c673-4a28-a3b2-31776a0c3580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:12.999039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401370e-c673-4a28-a3b2-31776a0c3580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.000682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401370e-c673-4a28-a3b2-31776a0c3580 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.016987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1691507c-0894-4c2a-be26-0e39776d294d None None] MFA Rules not processed for user `dfaae91aea1c48f598ac917ce3fdb442`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:13.018462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1691507c-0894-4c2a-be26-0e39776d294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:13.025614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 813/1640] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:13.027074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6822edc-8dac-4e50-8232-299dc5f4ac6a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.027362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6822edc-8dac-4e50-8232-299dc5f4ac6a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.027635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6822edc-8dac-4e50-8232-299dc5f4ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.094066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a6822edc-8dac-4e50-8232-299dc5f4ac6a None None] MFA Rules not processed for user `0e78a986ff764c1f956c1d8de9c7273b`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:13.100115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a6822edc-8dac-4e50-8232-299dc5f4ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:13.148732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 828/1641] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:13.150228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691507c-0894-4c2a-be26-0e39776d294d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.233574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 814/1642] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:13.235260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6822edc-8dac-4e50-8232-299dc5f4ac6a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.260505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691507c-0894-4c2a-be26-0e39776d294d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:13.267100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:13.268257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.269292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.269784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.270753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.273745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.312372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 829/1643] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:13 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:13.312372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.325297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6822edc-8dac-4e50-8232-299dc5f4ac6a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:13.328104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c005417-45e5-462b-a521-9bea190bb81a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:13.330008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:13.330776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.331053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.331322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.335753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:13.337193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.338392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.338860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] PATH_INFO: `/v3/projects/6df2026a6c78460ca288a3414f5446b1/users/147e038ac7094784a0e33b130ce019d7/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.342530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df2026a6c78460ca288a3414f5446b1, user_id=147e038ac7094784a0e33b130ce019d7, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.348467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.366785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 830/1644] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:13 2022] PUT /identity/v3/projects/6df2026a6c78460ca288a3414f5446b1/users/147e038ac7094784a0e33b130ce019d7/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:13.368014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.430053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.431842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.444844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 815/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:13.445757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.452533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:13.456063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:13.457141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e0718-5fea-40d6-b5ae-124a25ebf0cd service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:13.482429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c31b3-b889-4727-8afc-3c7f68f22ef7 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:13.486682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:13.488070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.488491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.488763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.524085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdf8d7-5390-4ae6-9190-be555d5195b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:13.524804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf8d7-5390-4ae6-9190-be555d5195b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.525142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf8d7-5390-4ae6-9190-be555d5195b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.525474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf8d7-5390-4ae6-9190-be555d5195b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.585954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.588724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.616672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 831/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:13 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:13.618825 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.647678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdf8d7-5390-4ae6-9190-be555d5195b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.649666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdf8d7-5390-4ae6-9190-be555d5195b0 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.675116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 816/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:13.677652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c942-39e4-48f3-aea6-d2c1a4ba17bd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.678129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c942-39e4-48f3-aea6-d2c1a4ba17bd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.678564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c942-39e4-48f3-aea6-d2c1a4ba17bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.726869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e797c942-39e4-48f3-aea6-d2c1a4ba17bd None None] MFA Rules not processed for user `147e038ac7094784a0e33b130ce019d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:13.728575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e797c942-39e4-48f3-aea6-d2c1a4ba17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:13.781499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e794231-e3d4-4a1c-ab07-93671eab3adf service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:13.788506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:13.789978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.790454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.790912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.792245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.795433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.809017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 832/1648] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:13.815861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.836398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c88ef-025a-4fcd-a314-bbc6d5a87e18 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:13.859880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:13.860667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:13.860949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:13.861221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] PATH_INFO: `/v3/projects/6bc6d7d74146446bb790c55e256793d2/users/af450338fdd04aa798dcaef8fcd28ad3/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:13.892387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc6d7d74146446bb790c55e256793d2, user_id=af450338fdd04aa798dcaef8fcd28ad3, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:13.895908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:13.905006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 817/1649] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:13.926328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c942-39e4-48f3-aea6-d2c1a4ba17bd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.936806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 833/1650] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:13 2022] PUT /identity/v3/projects/6bc6d7d74146446bb790c55e256793d2/users/af450338fdd04aa798dcaef8fcd28ad3/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:13.941402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:13.942011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c942-39e4-48f3-aea6-d2c1a4ba17bd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:14.019998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:14.058404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302dc1b-a835-47ca-b514-04b434c546b2 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:14.058935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:14.060116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.060952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.061663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.065497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:14.066562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.066562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.066943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.068020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:14.070519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:14.085076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 834/1651] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:14.089107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:14.101649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:14.113682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36166b-9f81-420f-8631-08c77c82cf5c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:14.124698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d11e7-8425-4136-b6e5-5b9aa46bbc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:14.126607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d11e7-8425-4136-b6e5-5b9aa46bbc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.127202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d11e7-8425-4136-b6e5-5b9aa46bbc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.127787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d11e7-8425-4136-b6e5-5b9aa46bbc78 admin admin] PATH_INFO: `/v3/projects/6bc6d7d74146446bb790c55e256793d2/users/af450338fdd04aa798dcaef8fcd28ad3/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.137055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d11e7-8425-4136-b6e5-5b9aa46bbc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc6d7d74146446bb790c55e256793d2, user_id=af450338fdd04aa798dcaef8fcd28ad3, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:14.140238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d11e7-8425-4136-b6e5-5b9aa46bbc78 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:14.165951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 835/1652] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:14 2022] PUT /identity/v3/projects/6bc6d7d74146446bb790c55e256793d2/users/af450338fdd04aa798dcaef8fcd28ad3/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:14.180668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431aaf3-1b7d-4c2e-9f79-4ec60315ea7d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.182286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431aaf3-1b7d-4c2e-9f79-4ec60315ea7d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.182416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431aaf3-1b7d-4c2e-9f79-4ec60315ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.231653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:14.232616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d431aaf3-1b7d-4c2e-9f79-4ec60315ea7d None None] MFA Rules not processed for user `af450338fdd04aa798dcaef8fcd28ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:14.237016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d431aaf3-1b7d-4c2e-9f79-4ec60315ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:14.237650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:14.257972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 818/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:14.418314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 836/1654] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:14.469693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:14.483514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5740-4973-4c17-927d-797b1580a75a service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:14.576118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd218c9-1d09-491b-85ba-36f6d9d4b5a2 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.576546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd218c9-1d09-491b-85ba-36f6d9d4b5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.576931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd218c9-1d09-491b-85ba-36f6d9d4b5a2 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.578532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 837/1655] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 30 09:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:35:14.585337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:14.586095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.586891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.587261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.598038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a15960-2e00-4bda-a878-999ef587c203 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.598317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a15960-2e00-4bda-a878-999ef587c203 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.598896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a15960-2e00-4bda-a878-999ef587c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.682639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-92a15960-2e00-4bda-a878-999ef587c203 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:14.683889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-92a15960-2e00-4bda-a878-999ef587c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:14.708615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:14.711860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:14.729960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 819/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:14.818562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 838/1657] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 09:35:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:14.827964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:14.846102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef822-cea5-4349-80fd-daa85a9882bc service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:14.855693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51189-cc66-465f-836b-74c8c1565340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:14.856665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51189-cc66-465f-836b-74c8c1565340 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:14.856943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51189-cc66-465f-836b-74c8c1565340 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:14.857418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51189-cc66-465f-836b-74c8c1565340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:14.984963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:15.038031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc51189-cc66-465f-836b-74c8c1565340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:15.054664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc51189-cc66-465f-836b-74c8c1565340 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:15.096715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 820/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:14 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:16.870440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63bce3-afc9-4819-80ca-96d09216fc63 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:16.870893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63bce3-afc9-4819-80ca-96d09216fc63 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:16.871008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63bce3-afc9-4819-80ca-96d09216fc63 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:16.872880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 839/1659] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:16.974163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c437d7-e2dc-495f-ad29-10f5e072da3f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:16.974722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c437d7-e2dc-495f-ad29-10f5e072da3f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:16.974722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c437d7-e2dc-495f-ad29-10f5e072da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:17.013356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e7c437d7-e2dc-495f-ad29-10f5e072da3f None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:17.014725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e7c437d7-e2dc-495f-ad29-10f5e072da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:17.116666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 821/1660] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:35:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:17.151063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63bce3-afc9-4819-80ca-96d09216fc63 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:17.169625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63bce3-afc9-4819-80ca-96d09216fc63 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:17.176724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca6c69-11ee-4b13-8675-75a3ecd6c26c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:17.177418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6c69-11ee-4b13-8675-75a3ecd6c26c service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:17.179208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6c69-11ee-4b13-8675-75a3ecd6c26c service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:17.179208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6c69-11ee-4b13-8675-75a3ecd6c26c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:17.209928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca6c69-11ee-4b13-8675-75a3ecd6c26c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:17.219293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca6c69-11ee-4b13-8675-75a3ecd6c26c service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:17.269979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 840/1661] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:23.981164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee2d4-a677-4274-8538-66afd9cc415c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:23.981942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee2d4-a677-4274-8538-66afd9cc415c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:23.981942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee2d4-a677-4274-8538-66afd9cc415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:24.033761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-55cee2d4-a677-4274-8538-66afd9cc415c None None] MFA Rules not processed for user `b7de0ef4197c40b4b64dfc0339c19705`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:24.036573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-55cee2d4-a677-4274-8538-66afd9cc415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:24.196498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 822/1662] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:24.228919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe66f7-1f5f-49d4-8c70-92bff843a790 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:24.229518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe66f7-1f5f-49d4-8c70-92bff843a790 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:24.229518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe66f7-1f5f-49d4-8c70-92bff843a790 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:24.231598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 841/1663] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 30 09:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:24.238732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e3e70-c6ac-4be3-8ba5-e6ea4957afe6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:24.239962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e3e70-c6ac-4be3-8ba5-e6ea4957afe6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:24.240429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e3e70-c6ac-4be3-8ba5-e6ea4957afe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:24.279818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-330e3e70-c6ac-4be3-8ba5-e6ea4957afe6 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:24.283176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-330e3e70-c6ac-4be3-8ba5-e6ea4957afe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:24.310050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe66f7-1f5f-49d4-8c70-92bff843a790 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:24.310742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 823/1664] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 09:35:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:24.334379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe66f7-1f5f-49d4-8c70-92bff843a790 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:24.341679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ac1d9-53eb-48b8-bdf2-137a90b47d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:24.342587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ac1d9-53eb-48b8-bdf2-137a90b47d04 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:24.343002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ac1d9-53eb-48b8-bdf2-137a90b47d04 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:24.343429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ac1d9-53eb-48b8-bdf2-137a90b47d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:24.354991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ac1d9-53eb-48b8-bdf2-137a90b47d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:24.356915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ac1d9-53eb-48b8-bdf2-137a90b47d04 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:24.370492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 842/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:27.140329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e3e70-c6ac-4be3-8ba5-e6ea4957afe6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:27.154589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e3e70-c6ac-4be3-8ba5-e6ea4957afe6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:27.170114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4092b1-9560-4a8c-bb10-1b5522ea4ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:27.171352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4092b1-9560-4a8c-bb10-1b5522ea4ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:27.172409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4092b1-9560-4a8c-bb10-1b5522ea4ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:27.172799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4092b1-9560-4a8c-bb10-1b5522ea4ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:27.389935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:27.401774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4092b1-9560-4a8c-bb10-1b5522ea4ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:27.404776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4092b1-9560-4a8c-bb10-1b5522ea4ad2 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:27.444679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 824/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:29.838469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138dcc1-44b2-4e0a-a8c5-c14871950120 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:29.841036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138dcc1-44b2-4e0a-a8c5-c14871950120 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:29.842321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138dcc1-44b2-4e0a-a8c5-c14871950120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:29.845074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd4011-98a5-4eeb-9011-b14f9dadf616 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:29.845641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd4011-98a5-4eeb-9011-b14f9dadf616 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:29.845896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd4011-98a5-4eeb-9011-b14f9dadf616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:29.942876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-97fd4011-98a5-4eeb-9011-b14f9dadf616 None None] MFA Rules not processed for user `7c242f07981e43c28e280d945631de66`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:29.944097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-97fd4011-98a5-4eeb-9011-b14f9dadf616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:29.953690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a138dcc1-44b2-4e0a-a8c5-c14871950120 None None] MFA Rules not processed for user `662238e056e640468faeb943a6f7fa0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:29.959961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a138dcc1-44b2-4e0a-a8c5-c14871950120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:30.006835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:30.108900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 825/1667] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:30.136042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd4011-98a5-4eeb-9011-b14f9dadf616 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:30.158021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd4011-98a5-4eeb-9011-b14f9dadf616 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:30.175838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:30.176477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:30.176749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:30.177012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:30.205707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:30.207882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:30.239774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 826/1668] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:30.239978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 843/1669] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:30.251576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:30.269162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb27b2-f294-4735-a3da-d323da99d97b service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:30.298862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:30.299488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:30.299757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:30.300020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:30.323491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:30.325976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:30.343779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 827/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:35:31.080886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138dcc1-44b2-4e0a-a8c5-c14871950120 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:31.230171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138dcc1-44b2-4e0a-a8c5-c14871950120 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:31.245184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e78a986ff764c1f956c1d8de9c7273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e6774ab11b440cc916591035095cd80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:31.246141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:31.246593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:31.247018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:31.248084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:31.248715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:31.250721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:31.288703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 844/1671] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:31.293297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:31.311327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db8016-52ff-428b-831d-e365dbeb5dfb service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:31.326920 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ba8eb-ee01-4e40-aa33-704fab0eeff1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e78a986ff764c1f956c1d8de9c7273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e6774ab11b440cc916591035095cd80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:31.327724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ba8eb-ee01-4e40-aa33-704fab0eeff1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:31.328057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ba8eb-ee01-4e40-aa33-704fab0eeff1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:31.328333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ba8eb-ee01-4e40-aa33-704fab0eeff1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:31.330336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ba8eb-ee01-4e40-aa33-704fab0eeff1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:31.336041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ba8eb-ee01-4e40-aa33-704fab0eeff1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:31.421040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 828/1672] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:31 2022] POST /identity/v3/projects => generated 348 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:31.425482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:31.440666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9addef-d3e2-492f-963f-fac452bf21fd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:31.579358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a09b4-328a-46c0-92b2-ab8eef20a4cd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e78a986ff764c1f956c1d8de9c7273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e6774ab11b440cc916591035095cd80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:31.579908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a09b4-328a-46c0-92b2-ab8eef20a4cd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:31.580185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a09b4-328a-46c0-92b2-ab8eef20a4cd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:31.580599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a09b4-328a-46c0-92b2-ab8eef20a4cd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:31.581262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a09b4-328a-46c0-92b2-ab8eef20a4cd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:31.581566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a09b4-328a-46c0-92b2-ab8eef20a4cd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:31.583224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a09b4-328a-46c0-92b2-ab8eef20a4cd tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:31.612253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 845/1673] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:31.625614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ddbe-f0e8-4087-8800-e643e46c453a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:31.625957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ddbe-f0e8-4087-8800-e643e46c453a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:31.627911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ddbe-f0e8-4087-8800-e643e46c453a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:31.630800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 829/1674] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:35:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:31.716951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b221-6004-4123-a01f-03d3ac7ca861 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:31.717285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b221-6004-4123-a01f-03d3ac7ca861 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:31.717491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b221-6004-4123-a01f-03d3ac7ca861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:31.756753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c853b221-6004-4123-a01f-03d3ac7ca861 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:31.757862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c853b221-6004-4123-a01f-03d3ac7ca861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:31.825286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2162b-6b15-4d45-a2c3-f2002f3b5f4b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:31.825752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2162b-6b15-4d45-a2c3-f2002f3b5f4b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:31.825917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2162b-6b15-4d45-a2c3-f2002f3b5f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:31.866252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-90d2162b-6b15-4d45-a2c3-f2002f3b5f4b None None] MFA Rules not processed for user `b7de0ef4197c40b4b64dfc0339c19705`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:31.867498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-90d2162b-6b15-4d45-a2c3-f2002f3b5f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:31.884627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:31.957049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 846/1675] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:35:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:32.028403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 830/1676] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:32.100514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b221-6004-4123-a01f-03d3ac7ca861 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:32.121064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b221-6004-4123-a01f-03d3ac7ca861 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:32.147762 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:32.148440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:32.148711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:32.149002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:32.187012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:32.189650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:32.192829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddb64-39bf-4901-96cc-4da4b8c7470f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:32.193145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddb64-39bf-4901-96cc-4da4b8c7470f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:32.193552 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddb64-39bf-4901-96cc-4da4b8c7470f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:32.196340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 831/1677] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 30 09:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:32.202574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5a46-552e-46f7-937b-cffe980aa809 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:32.202844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5a46-552e-46f7-937b-cffe980aa809 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:32.203113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5a46-552e-46f7-937b-cffe980aa809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:32.248427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 847/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:32.268846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bbac5a46-552e-46f7-937b-cffe980aa809 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:32.270135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bbac5a46-552e-46f7-937b-cffe980aa809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:32.357567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:32.428006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 832/1679] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 09:35:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:32.435937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:32.437363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:32.691049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c60d1-8274-4cc0-8986-12dbb6d4bd56 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:32.702354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77625f61bca4548af4cd5702d2b807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:32.703109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:32.703388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:32.703688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:32.734469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:32.735941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:32.764891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 848/1680] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:33.821175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac5a46-552e-46f7-937b-cffe980aa809 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:33.835564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac5a46-552e-46f7-937b-cffe980aa809 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:33.847535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e78a986ff764c1f956c1d8de9c7273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e6774ab11b440cc916591035095cd80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:33.848246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:33.848704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:33.851037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] PATH_INFO: `/v3/projects/7ae188b5e1614ebaac9ad4e54d9cb593` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:33.852432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ae188b5e1614ebaac9ad4e54d9cb593)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:33.853712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING py.warnings [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:33.853712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: warnings.warn(msg) Sep 30 09:35:33.853712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: Sep 30 09:35:33.855233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:34.057967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae188b5e1614ebaac9ad4e54d9cb593', 'request_id': 'req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:34.113019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae188b5e1614ebaac9ad4e54d9cb593', 'request_id': 'req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:34.124352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae188b5e1614ebaac9ad4e54d9cb593', 'request_id': 'req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:34.155344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] The token cache is being invalidate because project 7ae188b5e1614ebaac9ad4e54d9cb593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:34.155642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:34.162259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6369a5d7-5d47-44ec-a79b-d62bc3e880b1 tempest-RoutersIpV6AdminTest-1307063202 tempest-RoutersIpV6AdminTest-1307063202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:34.178689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 833/1681] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:33 2022] DELETE /identity/v3/projects/7ae188b5e1614ebaac9ad4e54d9cb593 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:34.214047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:34.267925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bf015-4b7b-4b60-b0be-b3118adc1547 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:34.268358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bf015-4b7b-4b60-b0be-b3118adc1547 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:34.268785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bf015-4b7b-4b60-b0be-b3118adc1547 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:34.271039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 834/1682] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 30 09:35:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:34.277770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:34.278346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:34.278897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:34.366494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a6b3e-d908-43c9-87fa-74041171aa16 service glance] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:34.380396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:34.384766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:34.449284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccddb7-49e6-4202-8d6f-ca8f5002a1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:34.450000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccddb7-49e6-4202-8d6f-ca8f5002a1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:34.450338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccddb7-49e6-4202-8d6f-ca8f5002a1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:34.450710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccddb7-49e6-4202-8d6f-ca8f5002a1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:34.457389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4dccddb7-49e6-4202-8d6f-ca8f5002a1c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:34.492872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:34.521697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 835/1683] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 09:35:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:34.550879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:34.552644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:34.569647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccddb7-49e6-4202-8d6f-ca8f5002a1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:34.571357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccddb7-49e6-4202-8d6f-ca8f5002a1c1 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:34.571577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd43a-f7b2-4535-ac27-02f0ac533c06 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:34.585045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 849/1684] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:34.585465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05aa391-0cae-4cd4-8f85-6390e5ef3ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:34.586120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aa391-0cae-4cd4-8f85-6390e5ef3ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:34.586615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aa391-0cae-4cd4-8f85-6390e5ef3ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:34.586816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aa391-0cae-4cd4-8f85-6390e5ef3ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:34.605967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aa391-0cae-4cd4-8f85-6390e5ef3ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:34.607737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aa391-0cae-4cd4-8f85-6390e5ef3ad2 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:34.629547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 836/1685] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:35:35.672341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09245-53af-4447-af4d-0060d47a82b6 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:35.673311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09245-53af-4447-af4d-0060d47a82b6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:35.673903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09245-53af-4447-af4d-0060d47a82b6 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:35.675359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 850/1686] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 30 09:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:35.686896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:35.687450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:35.687450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:35.722658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09245-53af-4447-af4d-0060d47a82b6 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:35.725062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-82e09245-53af-4447-af4d-0060d47a82b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:35.743185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:35.745225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:35.801099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:35.862315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 837/1687] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 09:35:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:35.922445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09245-53af-4447-af4d-0060d47a82b6 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:35.929579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915cf97-481e-41d0-bf30-76e3d83fef55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:35.931781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915cf97-481e-41d0-bf30-76e3d83fef55 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:35.932198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915cf97-481e-41d0-bf30-76e3d83fef55 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:35.932637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915cf97-481e-41d0-bf30-76e3d83fef55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:35.934750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9915cf97-481e-41d0-bf30-76e3d83fef55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:35.954085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915cf97-481e-41d0-bf30-76e3d83fef55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:35.955978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915cf97-481e-41d0-bf30-76e3d83fef55 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:35.968666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 851/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:35.980638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:35.982575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:35.995647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37aced-ee67-4cc0-a56c-226aa2c85a63 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:36.000345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d618c6a-11f7-4ae9-86e9-b2a5235f6654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:36.000966 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d618c6a-11f7-4ae9-86e9-b2a5235f6654 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:36.001234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d618c6a-11f7-4ae9-86e9-b2a5235f6654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:36.001559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d618c6a-11f7-4ae9-86e9-b2a5235f6654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:36.013692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d618c6a-11f7-4ae9-86e9-b2a5235f6654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:36.015564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d618c6a-11f7-4ae9-86e9-b2a5235f6654 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:36.028304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 838/1689] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:37.261181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:37.262250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:37.263062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:37.339610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] MFA Rules not processed for user `7c242f07981e43c28e280d945631de66`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:37.342141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:37.511579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 852/1690] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:38.432793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e803fdb-5fbd-4ec7-9835-e92186207408 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:38.433489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e803fdb-5fbd-4ec7-9835-e92186207408 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:38.433489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e803fdb-5fbd-4ec7-9835-e92186207408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:38.455378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9e803fdb-5fbd-4ec7-9835-e92186207408 None None] MFA Rules not processed for user `662238e056e640468faeb943a6f7fa0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:38.456903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9e803fdb-5fbd-4ec7-9835-e92186207408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:38.677284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:38.678808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:38.688425 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 839/1691] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:38.828205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:38.835279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be686d5-204d-4640-8fa7-06060d6911b2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:38.840950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:38.842084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:38.842559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:38.842826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] PATH_INFO: `/v3/users/e8a49c104e9440fa848d7cfd59baa6fd` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:38.844013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a49c104e9440fa848d7cfd59baa6fd)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:38.845354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: WARNING py.warnings [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:38.845354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: warnings.warn(msg) Sep 30 09:35:38.845354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: Sep 30 09:35:38.847217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:38.928665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a49c104e9440fa848d7cfd59baa6fd'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:38.929851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a49c104e9440fa848d7cfd59baa6fd'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:38.959990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a49c104e9440fa848d7cfd59baa6fd'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:38.966804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:38.967558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:38.967723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.001947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a49c104e9440fa848d7cfd59baa6fd'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:39.002950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-fab9b27c-c5e5-4ee2-9c56-03992d2ae5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a49c104e9440fa848d7cfd59baa6fd'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:39.014990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:39.016594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.028827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 853/1692] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:38 2022] DELETE /identity/v3/users/e8a49c104e9440fa848d7cfd59baa6fd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:39.035045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.035548 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.036055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.037758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 840/1693] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 09:35:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:39.059028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:39.060518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.096072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:39.097888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.114333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7cab8-df3b-4286-9f04-b6a4b6e36113 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:39.159354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 854/1694] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:39.201248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5efbe-40c5-435b-b542-7e6e756e4bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:39.201917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5efbe-40c5-435b-b542-7e6e756e4bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.202199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5efbe-40c5-435b-b542-7e6e756e4bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.202470 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5efbe-40c5-435b-b542-7e6e756e4bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.214139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5efbe-40c5-435b-b542-7e6e756e4bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:39.217650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5efbe-40c5-435b-b542-7e6e756e4bc9 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:39.218289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:39.219776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.233545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 841/1695] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:39.237024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17b3ed-9d3f-4e77-9f7b-4889c049f5af None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:39.242999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:39.243903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.244350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.244787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.256090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:39.257905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:39.280847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 855/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:35:39.290387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8623d-1ac4-4ac3-89af-5cd49b9a3552 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.291104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8623d-1ac4-4ac3-89af-5cd49b9a3552 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.291568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8623d-1ac4-4ac3-89af-5cd49b9a3552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.337900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:39.339437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.365004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960674e-00df-4990-8d1f-0e1bdc908b7a service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:39.378871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:39.380001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.380001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.380391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] PATH_INFO: `/v3/users/c16b6986a5314d569c19f820bcfa4270` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.383620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16b6986a5314d569c19f820bcfa4270)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:39.385761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:39.405668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-31b8623d-1ac4-4ac3-89af-5cd49b9a3552 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:39.408260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-31b8623d-1ac4-4ac3-89af-5cd49b9a3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.467882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:39.500673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16b6986a5314d569c19f820bcfa4270'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:39.502869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16b6986a5314d569c19f820bcfa4270'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:39.521270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:39.533700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16b6986a5314d569c19f820bcfa4270'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:39.552626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16b6986a5314d569c19f820bcfa4270'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:39.553413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16b6986a5314d569c19f820bcfa4270'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:39.573890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 842/1697] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 09:35:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:39.574464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 856/1698] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:39 2022] DELETE /identity/v3/users/c16b6986a5314d569c19f820bcfa4270 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:35:39.581314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.581593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.586670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.635618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:39.641422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.725111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 843/1699] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:39.764370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:39.766181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.793125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:39.795233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.914420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cfa43-2fcc-4d41-b7d8-100913146d58 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:39.920851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:39.921835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.922546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.922823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.935880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:39.937727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:39.954509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 844/1700] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:40.040995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48607-2d9f-4c62-9666-9c0daed9ae33 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:40.058310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:40.059253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:40.059646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:40.059982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:40.064241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:40.159233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:40.161014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:40.170597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 857/1701] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 09:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:35:40.754517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:40.756072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:40.821259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ded2-9f9d-4689-a914-6f28c5a524fe service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:40.836008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:40.838555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:40.838841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:40.839119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] PATH_INFO: `/v3/projects/dc420303910c49cbba449d5bc6687f0c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:40.840474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc420303910c49cbba449d5bc6687f0c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:40.843319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:40.993282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc420303910c49cbba449d5bc6687f0c', 'request_id': 'req-260b7a72-6cf6-408d-8529-830a302d2637'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.011002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc420303910c49cbba449d5bc6687f0c', 'request_id': 'req-260b7a72-6cf6-408d-8529-830a302d2637'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.018109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc420303910c49cbba449d5bc6687f0c', 'request_id': 'req-260b7a72-6cf6-408d-8529-830a302d2637'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.039128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:41.045988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] The token cache is being invalidate because project dc420303910c49cbba449d5bc6687f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:41.046412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.048501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.052101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 845/1702] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:40 2022] DELETE /identity/v3/projects/dc420303910c49cbba449d5bc6687f0c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:41.057308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:41.084800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f964f57-b6b2-4668-ba86-8d5ea5bc757a service swift] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:41.236588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:41.254182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:41.256174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:41.256470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:41.256746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] PATH_INFO: `/v3/users/147e038ac7094784a0e33b130ce019d7` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:41.257955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147e038ac7094784a0e33b130ce019d7)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:41.260307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:41.492677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147e038ac7094784a0e33b130ce019d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.497574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147e038ac7094784a0e33b130ce019d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.524415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147e038ac7094784a0e33b130ce019d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.544160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147e038ac7094784a0e33b130ce019d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.545676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147e038ac7094784a0e33b130ce019d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:41.578722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:41.580167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:41.586392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 858/1703] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:41 2022] DELETE /identity/v3/users/147e038ac7094784a0e33b130ce019d7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:41.617287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b7a72-6cf6-408d-8529-830a302d2637 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:41.902201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:41.902824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:41.903103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:41.903381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] PATH_INFO: `/v3/projects/19098ab8842b4d0e85ba4d94e10317b7` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:41.909726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=19098ab8842b4d0e85ba4d94e10317b7)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:41.917000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:42.051291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19098ab8842b4d0e85ba4d94e10317b7', 'request_id': 'req-1c68fcc5-83cb-4801-a4f4-e42c222042ee'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.066839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19098ab8842b4d0e85ba4d94e10317b7', 'request_id': 'req-1c68fcc5-83cb-4801-a4f4-e42c222042ee'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.083908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19098ab8842b4d0e85ba4d94e10317b7', 'request_id': 'req-1c68fcc5-83cb-4801-a4f4-e42c222042ee'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.116420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] The token cache is being invalidate because project 19098ab8842b4d0e85ba4d94e10317b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:42.116753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.118650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.122561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 846/1704] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:41 2022] DELETE /identity/v3/projects/19098ab8842b4d0e85ba4d94e10317b7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:42.126965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:42.130252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:42.211826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7c4a3-2efb-4521-bfb0-677b387b0f96 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:42.378800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:42.379806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:42.380183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:42.380708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] PATH_INFO: `/v3/users/dfaae91aea1c48f598ac917ce3fdb442` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:42.382671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfaae91aea1c48f598ac917ce3fdb442)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:42.389410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:42.553546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfaae91aea1c48f598ac917ce3fdb442'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.554868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfaae91aea1c48f598ac917ce3fdb442'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.616174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfaae91aea1c48f598ac917ce3fdb442'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.630125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfaae91aea1c48f598ac917ce3fdb442'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.631783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-899d3ecb-077d-4470-91a1-4045eedd8633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfaae91aea1c48f598ac917ce3fdb442'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:42.635899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:42.675692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 859/1705] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:42 2022] DELETE /identity/v3/users/dfaae91aea1c48f598ac917ce3fdb442 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:42.829883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:42.831360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:42.872238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fcc5-83cb-4801-a4f4-e42c222042ee admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:43.119840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:43.120528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:43.120817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:43.121131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] PATH_INFO: `/v3/users/a2a2b2d68d1a4630bc57f1de01131144` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:43.122862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a2b2d68d1a4630bc57f1de01131144)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:43.124821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:43.244562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:43.270461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a2b2d68d1a4630bc57f1de01131144'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:43.280439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a2b2d68d1a4630bc57f1de01131144'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:43.281493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a2b2d68d1a4630bc57f1de01131144'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:43.282912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a2b2d68d1a4630bc57f1de01131144'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:43.299439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a2b2d68d1a4630bc57f1de01131144'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:43.335232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 847/1706] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:42 2022] DELETE /identity/v3/users/a2a2b2d68d1a4630bc57f1de01131144 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:43.339898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:43.340475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:43.340475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:43.411324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:43.412666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:43.528669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 860/1707] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:43.929563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:43.931105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:44.093714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dad56-30f6-4e89-8d16-a6f0ff8aceba admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:44.099548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:44.100574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:44.100973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:44.101339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:44.116451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:44.118733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:44.151370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 848/1708] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:44.844134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:44.846293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:44.863687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2c4f-4d11-4f3a-801d-708a1aac3b23 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:44.877412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:44.879267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:44.879656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:44.900201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92453-f96d-4354-89ac-6b6af7707e84 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:44.914116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:44.914992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:44.915437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:44.916116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] PATH_INFO: `/v3/projects/6df2026a6c78460ca288a3414f5446b1` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:44.919756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df2026a6c78460ca288a3414f5446b1)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:44.921273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:44.921690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:44.922002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] PATH_INFO: `/v3/projects/f30c363278b74b7c8bfa10ee54a7f9e4` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:44.924064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:44.928582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30c363278b74b7c8bfa10ee54a7f9e4)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:44.931898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:45.065250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df2026a6c78460ca288a3414f5446b1', 'request_id': 'req-300f7ac3-3cc7-4881-92b5-045cd815494b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.110163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df2026a6c78460ca288a3414f5446b1', 'request_id': 'req-300f7ac3-3cc7-4881-92b5-045cd815494b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.133633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df2026a6c78460ca288a3414f5446b1', 'request_id': 'req-300f7ac3-3cc7-4881-92b5-045cd815494b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.160396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] The token cache is being invalidate because project 6df2026a6c78460ca288a3414f5446b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:45.161092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.162326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-300f7ac3-3cc7-4881-92b5-045cd815494b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.169779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 849/1709] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:44 2022] DELETE /identity/v3/projects/6df2026a6c78460ca288a3414f5446b1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:45.171360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30c363278b74b7c8bfa10ee54a7f9e4', 'request_id': 'req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.172374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb805-a4ec-411c-a82f-b231803bc418 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.172924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb805-a4ec-411c-a82f-b231803bc418 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.173164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb805-a4ec-411c-a82f-b231803bc418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.183367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30c363278b74b7c8bfa10ee54a7f9e4', 'request_id': 'req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.195685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30c363278b74b7c8bfa10ee54a7f9e4', 'request_id': 'req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.210315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] The token cache is being invalidate because project f30c363278b74b7c8bfa10ee54a7f9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:45.211018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.212016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d8a7e0d8-b0c3-4da0-b0e6-2b9de2e00a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:45.217811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 861/1710] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:44 2022] DELETE /identity/v3/projects/f30c363278b74b7c8bfa10ee54a7f9e4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:45.218694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4ccdb805-a4ec-411c-a82f-b231803bc418 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:45.219361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80b49-58f1-4548-8b47-8541e9178fee None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.219699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80b49-58f1-4548-8b47-8541e9178fee None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.220027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80b49-58f1-4548-8b47-8541e9178fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.220253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4ccdb805-a4ec-411c-a82f-b231803bc418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:45.267104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-30e80b49-58f1-4548-8b47-8541e9178fee None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:45.268692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-30e80b49-58f1-4548-8b47-8541e9178fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:45.291478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:45.426583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 850/1711] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:45.433060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab35fc-05cb-43d3-a803-c998ed83159a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.433454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab35fc-05cb-43d3-a803-c998ed83159a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.436138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab35fc-05cb-43d3-a803-c998ed83159a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.553659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-22ab35fc-05cb-43d3-a803-c998ed83159a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:45.563766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-22ab35fc-05cb-43d3-a803-c998ed83159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:45.573927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 862/1712] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:45.579176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234256-3a19-4b49-b9a1-330f34ef0f53 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.582045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234256-3a19-4b49-b9a1-330f34ef0f53 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.582274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234256-3a19-4b49-b9a1-330f34ef0f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.595847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 851/1713] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:45.600009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1aeb-6576-465f-990d-2c3027fbc915 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.601283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1aeb-6576-465f-990d-2c3027fbc915 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.602843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1aeb-6576-465f-990d-2c3027fbc915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.642772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-19234256-3a19-4b49-b9a1-330f34ef0f53 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:45.645759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-19234256-3a19-4b49-b9a1-330f34ef0f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:45.681409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:45.683473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cb9a1aeb-6576-465f-990d-2c3027fbc915 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:45.691160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cb9a1aeb-6576-465f-990d-2c3027fbc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:45.724028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 852/1714] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:45.724028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a1aeb-6576-465f-990d-2c3027fbc915 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:45.750384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a1aeb-6576-465f-990d-2c3027fbc915 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:45.756175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:45.757101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.758448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.759036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.760726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:45.761298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:45.764693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:45.833308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 853/1715] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:45.833308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:45.834988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:45.857037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 863/1716] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Sep 30 09:35:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:45.858651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234256-3a19-4b49-b9a1-330f34ef0f53 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:45.864578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b653f56-c391-4f77-a015-06d14d14d199 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:45.878402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:45.879746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.880079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.880360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] PATH_INFO: `/v3/projects/9c4228d57cfd47279f27b1ba70ca3e9f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.881642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4228d57cfd47279f27b1ba70ca3e9f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:45.885070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:45.911826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234256-3a19-4b49-b9a1-330f34ef0f53 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:45.928983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:45.930121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:45.930544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:45.930953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:45.931744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:45.932182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:45.936280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:45.956767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 864/1717] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:45.957772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:45.995882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e84e8-7587-47e0-b51d-f08911b34e97 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.016251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:46.017467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:46.017750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:46.018581 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:46.020678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:46.051482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4228d57cfd47279f27b1ba70ca3e9f', 'request_id': 'req-26225696-d14d-4f24-a63b-46df5bca5b60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.060667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:46.082678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4228d57cfd47279f27b1ba70ca3e9f', 'request_id': 'req-26225696-d14d-4f24-a63b-46df5bca5b60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.104667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4228d57cfd47279f27b1ba70ca3e9f', 'request_id': 'req-26225696-d14d-4f24-a63b-46df5bca5b60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.143631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] The token cache is being invalidate because project 9c4228d57cfd47279f27b1ba70ca3e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:46.145778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.147190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.154714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 865/1718] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:45 2022] POST /identity/v3/projects => generated 411 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:46.154714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:46.156026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 854/1719] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:45 2022] DELETE /identity/v3/projects/9c4228d57cfd47279f27b1ba70ca3e9f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:46.157392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:46.160100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:46.161601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:46.289220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26225696-d14d-4f24-a63b-46df5bca5b60 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.373962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:46.389428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:46.390319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:46.390895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:46.391296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:46.395822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:46.410792 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bce2fd-f420-4229-93c7-563954320683 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.422621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:46.423271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:46.423549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:46.423818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:46.424475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:46.424928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:46.426471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:46.431051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:46.453607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 855/1720] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:46.454778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:46.460064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:46.487226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 866/1721] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:46 2022] POST /identity/v3/projects => generated 389 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:46.488141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:46.499505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:46.505492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2ba13-8553-4fd9-a3d8-aab2bd88090c service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.638626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865ea53-b0ee-4b63-8485-4c56ae268611 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.650697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:46.651471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:46.651842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:46.652259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:46.653147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:46.658813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:46.659006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:46.659511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:46.659785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:46.660059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] PATH_INFO: `/v3/users/d7e21edcc8d246c2827c5375d32105a6` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:46.661327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e21edcc8d246c2827c5375d32105a6)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:46.663299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:46.707817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:46.723971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 856/1722] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:46 2022] POST /identity/v3/users => generated 306 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:46.727390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:46.763108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e21edcc8d246c2827c5375d32105a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.763881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e21edcc8d246c2827c5375d32105a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.781430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e21edcc8d246c2827c5375d32105a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.785354 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eeba2-a8b0-4695-8219-b37ae868f008 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.791472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e21edcc8d246c2827c5375d32105a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.792204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e21edcc8d246c2827c5375d32105a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:46.803758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:46.804954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:46.806648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:46.806934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:46.808976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:46.813192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:46.814901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 867/1723] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:46 2022] DELETE /identity/v3/users/d7e21edcc8d246c2827c5375d32105a6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:46.820408 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:46.825128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:46.880285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 857/1724] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:46 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:46.882399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:46.886443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:46.916858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23190636-d5cc-4655-8385-784d043bc79a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.981981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b77e-2ab9-4a30-a600-9244b7b3f383 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:46.993458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.004943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.005369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.005805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.006670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.008548 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:47.031148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 868/1725] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:47.032836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:47.049922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401322ca-e6b1-4216-991b-b4e8123ee1d6 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:47.055388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.056166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.056543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.056912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.062991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.064951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:47.082869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 869/1726] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:47.084020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:47.102602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114a678-c70c-4df0-8b8d-9eb03485bc20 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:47.104704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.106486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.108717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad3c0a-eac2-4aa5-a277-2526ea14e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.109586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3c0a-eac2-4aa5-a277-2526ea14e03c admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.110079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.110205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3c0a-eac2-4aa5-a277-2526ea14e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.110636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3c0a-eac2-4aa5-a277-2526ea14e03c admin admin] PATH_INFO: `/v3/projects/14c7024b3bff446f8313398d6fe59a4a/users/a01e12758bf64b609a9db720f7da6bc2/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.111226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.113007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.115586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:47.141398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad3c0a-eac2-4aa5-a277-2526ea14e03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c7024b3bff446f8313398d6fe59a4a, user_id=a01e12758bf64b609a9db720f7da6bc2, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.144399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad3c0a-eac2-4aa5-a277-2526ea14e03c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:47.148045 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 858/1727] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:47.152150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:47.172567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570305-dcbd-4ac6-8085-e83246228410 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:47.175960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 870/1728] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:47 2022] PUT /identity/v3/projects/14c7024b3bff446f8313398d6fe59a4a/users/a01e12758bf64b609a9db720f7da6bc2/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:47.187540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38fb6-67b6-4452-9ef8-17d1ff9f7a76 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.188055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38fb6-67b6-4452-9ef8-17d1ff9f7a76 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.188426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38fb6-67b6-4452-9ef8-17d1ff9f7a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.236203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-90d38fb6-67b6-4452-9ef8-17d1ff9f7a76 None None] MFA Rules not processed for user `a01e12758bf64b609a9db720f7da6bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:47.238780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-90d38fb6-67b6-4452-9ef8-17d1ff9f7a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:47.285615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:47.301478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.302068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.302404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.303297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.303514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.333442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:47.366422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 859/1729] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:47.370732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:47.388736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:47.399881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b86e5f-d80f-405b-9301-41fe427d372d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:47.425450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb609eb6-75a6-4fa6-b819-bc4069f6c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.426400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb609eb6-75a6-4fa6-b819-bc4069f6c18b admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.426682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb609eb6-75a6-4fa6-b819-bc4069f6c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.427246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb609eb6-75a6-4fa6-b819-bc4069f6c18b admin admin] PATH_INFO: `/v3/projects/efdcd8550e40438788de13a4403f0f7f/users/23647d1b09ce4e4cadaa20c410537b3e/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.466417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb609eb6-75a6-4fa6-b819-bc4069f6c18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdcd8550e40438788de13a4403f0f7f, user_id=23647d1b09ce4e4cadaa20c410537b3e, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.468018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 871/1730] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:47 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:47.469276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb609eb6-75a6-4fa6-b819-bc4069f6c18b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:47.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38fb6-67b6-4452-9ef8-17d1ff9f7a76 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:47.508822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 860/1731] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:47 2022] PUT /identity/v3/projects/efdcd8550e40438788de13a4403f0f7f/users/23647d1b09ce4e4cadaa20c410537b3e/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:47.519883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38fb6-67b6-4452-9ef8-17d1ff9f7a76 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:47.520697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.520974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.521255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.579553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] MFA Rules not processed for user `23647d1b09ce4e4cadaa20c410537b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:47.581370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:47.648203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.655046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.656196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.656609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.657968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.661285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:47.741680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 872/1732] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:47 2022] POST /identity/v3/projects => generated 409 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:47.747267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:47.863464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 861/1733] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:47.877129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:47.878886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:47.933111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57223-4851-4fe5-b195-80b2cda3ef6d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:47.947194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:47.947916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:47.948192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:47.948570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:47.951125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:47.953228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:48.012021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 873/1734] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:47 2022] POST /identity/v3/users => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:48.012902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179fde1-6500-4587-abaf-900cf98c7ed9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:48.013168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:48.043327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf495f78-ca4d-4151-b526-8233f44cfd19 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:48.063795 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335078-9183-4eea-918d-338a07660573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:48.065188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335078-9183-4eea-918d-338a07660573 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.065414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335078-9183-4eea-918d-338a07660573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.065688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335078-9183-4eea-918d-338a07660573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.066373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335078-9183-4eea-918d-338a07660573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:48.073555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335078-9183-4eea-918d-338a07660573 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:48.104933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 874/1735] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:48.110065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335078-9183-4eea-918d-338a07660573 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:48.113147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-da335078-9183-4eea-918d-338a07660573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:48.123327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:48.124205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.124666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.125111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.156488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335078-9183-4eea-918d-338a07660573 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:48.170599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:48.171297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.176471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.176807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] PATH_INFO: `/v3/projects/f6c4dc3dd144479593044e7911253b6e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.179957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c4dc3dd144479593044e7911253b6e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:48.190442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:48.260608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:48.321919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:48.328634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:48.328817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:48.332309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c4dc3dd144479593044e7911253b6e', 'request_id': 'req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:48.349851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c4dc3dd144479593044e7911253b6e', 'request_id': 'req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:48.356906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 862/1736] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:35:48.358692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:48.376001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec886f-9225-4e9a-9873-6496be3244bb service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:48.377843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c4dc3dd144479593044e7911253b6e', 'request_id': 'req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:48.402673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] The token cache is being invalidate because project f6c4dc3dd144479593044e7911253b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:48.404821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:48.407708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dfd1eaa4-bdf7-4e32-9ea4-46fd9715b697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:48.411217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 875/1737] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:48 2022] DELETE /identity/v3/projects/f6c4dc3dd144479593044e7911253b6e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:48.416451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62b92-e397-495a-96f5-6839108bea75 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.416784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62b92-e397-495a-96f5-6839108bea75 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.417368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62b92-e397-495a-96f5-6839108bea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.474549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c3b62b92-e397-495a-96f5-6839108bea75 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:48.477586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c3b62b92-e397-495a-96f5-6839108bea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:48.526495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:48.531315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.531754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.533903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] PATH_INFO: `/v3/projects/324fd546dc32477e97dcc3e70cf4af9f/users/f7e095f0388b415991ca1152d181e399/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.587866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=324fd546dc32477e97dcc3e70cf4af9f, user_id=f7e095f0388b415991ca1152d181e399, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:48.599823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:48.647934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 863/1738] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:48 2022] PUT /identity/v3/projects/324fd546dc32477e97dcc3e70cf4af9f/users/f7e095f0388b415991ca1152d181e399/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:48.648669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:48.651880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:48.672580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 876/1739] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:48.682798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.683081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.683343 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.750462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:48.753095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:48.871406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8463ee-bbe4-47e0-8f9c-04e1931f7e3a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:48.888802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:48.889430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.889708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.890008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.890657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:48.892303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:48.906607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 877/1740] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:48.908482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:48.911242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:48.927781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 864/1741] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:48.928672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:48.938782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a95e3-1a0d-4a48-9545-ac36a7b6395a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:48.952721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4c3f-582c-4ac6-85e6-14543f6650a0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:48.956339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:48.957007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.957296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.957598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] PATH_INFO: `/v3/users/23647d1b09ce4e4cadaa20c410537b3e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.959569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23647d1b09ce4e4cadaa20c410537b3e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:48.963445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:48.968518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:48.969139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:48.969413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:48.970340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:48.971030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:48.971322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:48.972976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:49.006407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 865/1742] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:49.007398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:49.036379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ee3ed-c2ce-42cc-9253-775634e8e2e7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:49.062749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23647d1b09ce4e4cadaa20c410537b3e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:49.063862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23647d1b09ce4e4cadaa20c410537b3e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:49.066301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:49.067197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:49.068257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:49.068555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] PATH_INFO: `/v3/projects/324fd546dc32477e97dcc3e70cf4af9f/users/f7e095f0388b415991ca1152d181e399/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:49.080169 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23647d1b09ce4e4cadaa20c410537b3e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:49.084250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=324fd546dc32477e97dcc3e70cf4af9f, user_id=f7e095f0388b415991ca1152d181e399, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:49.085039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:49.087810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:49.101836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23647d1b09ce4e4cadaa20c410537b3e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:49.102768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17f78106-d83a-486f-bcc1-3373b497e57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23647d1b09ce4e4cadaa20c410537b3e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:49.144015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 866/1744] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:49 2022] PUT /identity/v3/projects/324fd546dc32477e97dcc3e70cf4af9f/users/f7e095f0388b415991ca1152d181e399/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:49.146753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 878/1744] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:48 2022] DELETE /identity/v3/users/23647d1b09ce4e4cadaa20c410537b3e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:49.153653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808181d-c3ee-4a71-a4a3-97178948f777 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:49.154026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808181d-c3ee-4a71-a4a3-97178948f777 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:49.154232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808181d-c3ee-4a71-a4a3-97178948f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:49.155319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:49.163104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:49.218996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0808181d-c3ee-4a71-a4a3-97178948f777 None None] MFA Rules not processed for user `f7e095f0388b415991ca1152d181e399`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:49.220316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0808181d-c3ee-4a71-a4a3-97178948f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:49.272067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:49.318831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 879/1745] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:49.318831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:49.318831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:49.318831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:49.365481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:49.366976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:49.416522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8a12-282e-477f-80b3-2226f60814fc admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:49.587182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 880/1746] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:49.587182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:49.593194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:49.647369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:49.649387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:49.649682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:49.650059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:49.651238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:49.654701 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:49.723724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 867/1747] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:49 2022] POST /identity/v3/projects => generated 397 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:49.724712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:49.746942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a21a7-72ba-4806-8d0b-10f9e580f7b0 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:49.844412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:49.890551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554d04-3fe3-4378-91b5-ee538cfeaecb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:49.903938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:49.907646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:49.907998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:49.908281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:49.908953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:49.911034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:49.913633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:49.914588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:49.914878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:49.915141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:49.949129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 868/1748] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:49 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:49.950600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:49.966635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b87c-96fc-400b-bf8e-22780814f507 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:49.975750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:49.976654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:49.977181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:49.977644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:49.979922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:49.981201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:50.007545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 869/1749] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:50.008707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:50.033502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d4132-a6e3-4ed9-905c-35565a6862e5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:50.044089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:50.044717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.044992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.045250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.045923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:50.047736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:50.059154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:50.061015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:50.074722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 881/1750] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:50.075399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 870/1751] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:50.078813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:50.104788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291b1a2-a827-4d3d-908c-5e458b744988 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:50.123664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790efbfd-0166-48ee-ae78-b4e027a8a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:50.124360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790efbfd-0166-48ee-ae78-b4e027a8a4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.124639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790efbfd-0166-48ee-ae78-b4e027a8a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.124909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790efbfd-0166-48ee-ae78-b4e027a8a4ec admin admin] PATH_INFO: `/v3/projects/eff09cdd6cca450d8f76d57937193e45/users/af4e2b7eee0c405898f836d492173fc7/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.167558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790efbfd-0166-48ee-ae78-b4e027a8a4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff09cdd6cca450d8f76d57937193e45, user_id=af4e2b7eee0c405898f836d492173fc7, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:50.170747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790efbfd-0166-48ee-ae78-b4e027a8a4ec admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:50.186377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:50.189694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:50.192350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:50.209762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 871/1752] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:50 2022] PUT /identity/v3/projects/eff09cdd6cca450d8f76d57937193e45/users/af4e2b7eee0c405898f836d492173fc7/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:50.214286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0960fd-717a-4034-999a-11b259ca4e44 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.214568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0960fd-717a-4034-999a-11b259ca4e44 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.214890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0960fd-717a-4034-999a-11b259ca4e44 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.219820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 872/1753] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:35:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:50.221644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d53f-6032-4453-b6cf-acc912639850 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:50.227421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f38c-2f11-4ca8-9672-3c442c6d2c82 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.228374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f38c-2f11-4ca8-9672-3c442c6d2c82 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.228374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f38c-2f11-4ca8-9672-3c442c6d2c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.306785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3767f38c-2f11-4ca8-9672-3c442c6d2c82 None None] MFA Rules not processed for user `af4e2b7eee0c405898f836d492173fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:50.308900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3767f38c-2f11-4ca8-9672-3c442c6d2c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:50.366547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:50.372980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.374541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.378130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.471167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 873/1754] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:50.472995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524894d-9e05-40f5-a6fa-b01bd65b90b5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.473480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524894d-9e05-40f5-a6fa-b01bd65b90b5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.474016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524894d-9e05-40f5-a6fa-b01bd65b90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.502843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0524894d-9e05-40f5-a6fa-b01bd65b90b5 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:50.504529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0524894d-9e05-40f5-a6fa-b01bd65b90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:50.618648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:50.621131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:50.655315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 882/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:50.659175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 874/1756] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:35:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:50.676433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:50.711766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c46f4-07da-4e3f-9adc-f360aab9c798 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:50.733236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:50.736763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.738799 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.739725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.783734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:50.786038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:50.812580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 883/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:50.906557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524894d-9e05-40f5-a6fa-b01bd65b90b5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:50.924123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524894d-9e05-40f5-a6fa-b01bd65b90b5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:50.933879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea79e4-6adb-439f-85c0-226eb64ceb19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:50.934545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea79e4-6adb-439f-85c0-226eb64ceb19 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:50.934660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea79e4-6adb-439f-85c0-226eb64ceb19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:50.934928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea79e4-6adb-439f-85c0-226eb64ceb19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:50.941507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5aea79e4-6adb-439f-85c0-226eb64ceb19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:51.011003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:51.013653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:51.045401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deab1b-1826-4115-a801-187c3a40fa5f service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:51.055301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:51.056745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:51.057601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:51.058276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:51.074016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:51.076745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:51.098127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea79e4-6adb-439f-85c0-226eb64ceb19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:51.099591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea79e4-6adb-439f-85c0-226eb64ceb19 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:51.110061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 884/1758] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:35:51.127600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 875/1759] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:52.723941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:52.726905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:52.735984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:52.744482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea109-2ad4-4023-b970-9ed35521ca1e service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:52.750755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:52.751654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:52.752140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:52.752613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] PATH_INFO: `/v3/projects/efdcd8550e40438788de13a4403f0f7f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:52.754127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdcd8550e40438788de13a4403f0f7f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:52.756253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:52.842267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdcd8550e40438788de13a4403f0f7f', 'request_id': 'req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:52.850193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdcd8550e40438788de13a4403f0f7f', 'request_id': 'req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:52.861255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdcd8550e40438788de13a4403f0f7f', 'request_id': 'req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:52.891780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] The token cache is being invalidate because project efdcd8550e40438788de13a4403f0f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:35:52.892442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:52.893521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cf5c6d5d-2158-4571-b52a-f5ef2fd9bf87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:52.895778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 885/1760] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:35:52 2022] DELETE /identity/v3/projects/efdcd8550e40438788de13a4403f0f7f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:52.900623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156ef3-6412-43cc-b110-4e3774183255 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:52.901149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156ef3-6412-43cc-b110-4e3774183255 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:52.901149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156ef3-6412-43cc-b110-4e3774183255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:52.938707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d4156ef3-6412-43cc-b110-4e3774183255 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:52.943008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d4156ef3-6412-43cc-b110-4e3774183255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:52.968573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:53.095762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 876/1761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:53.104066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72930-2916-4322-a643-9afe5914e699 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.104913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72930-2916-4322-a643-9afe5914e699 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.105242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72930-2916-4322-a643-9afe5914e699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.137360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4fd72930-2916-4322-a643-9afe5914e699 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:53.139323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4fd72930-2916-4322-a643-9afe5914e699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:53.160250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 886/1762] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:53.161709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156ef3-6412-43cc-b110-4e3774183255 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:53.176292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156ef3-6412-43cc-b110-4e3774183255 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:53.192228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:53.194224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.195962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.196342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.198769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:35:53.200334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:53.205282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:53.238177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 877/1763] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:35:53.242952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd72930-2916-4322-a643-9afe5914e699 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:53.260386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd72930-2916-4322-a643-9afe5914e699 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:53.273695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:53.274575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.275741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.276156 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.280892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:53.283889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:53.352125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 887/1764] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:35:53 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:53.357311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:53.376344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3aa8-068f-457b-b68f-03f3dca6edce admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:53.542585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:53.543585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.543961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.544327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.545071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:53.547205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:53.597167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 878/1765] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:35:53 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:35:53.598913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:53.614810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a704-f7bf-40b2-a779-7fbe93f8cfc4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:53.630247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:53.630899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.631170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.631432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.632365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:53.634133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:53.659007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 888/1766] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:53.660288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:53.683505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9accec-c32b-43de-8a1a-b32d991e0aad admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:53.701819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6947bb-75a5-481f-b6a1-96567bc734aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:53.702513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6947bb-75a5-481f-b6a1-96567bc734aa admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.702785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6947bb-75a5-481f-b6a1-96567bc734aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.703115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6947bb-75a5-481f-b6a1-96567bc734aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.706764 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6947bb-75a5-481f-b6a1-96567bc734aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:53.709823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6947bb-75a5-481f-b6a1-96567bc734aa admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:53.746826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 879/1767] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:53.747177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:53.765128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345d80e-463a-4674-a185-143dc02db7c3 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:53.783390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:53.786590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.787090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.789044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] PATH_INFO: `/v3/projects/e4974e3c5c96471e9afac56c3fd3751f/users/0b1897ffb368459d9dfdca560e909427/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.838699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4974e3c5c96471e9afac56c3fd3751f, user_id=0b1897ffb368459d9dfdca560e909427, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:53.850203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:53.891086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 889/1768] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:35:53 2022] PUT /identity/v3/projects/e4974e3c5c96471e9afac56c3fd3751f/users/0b1897ffb368459d9dfdca560e909427/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:35:53.909493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:53.910502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:53.911154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:53.969473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] MFA Rules not processed for user `0b1897ffb368459d9dfdca560e909427`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:53.971169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:54.161220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 880/1769] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:54.263055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:54.268775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:54.366801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77abca2-2afd-4501-a33d-78d7f3818903 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:54.372935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693438-372b-4f6f-a6df-1ee01c9404b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:54.373851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693438-372b-4f6f-a6df-1ee01c9404b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:54.374247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693438-372b-4f6f-a6df-1ee01c9404b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:54.377907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693438-372b-4f6f-a6df-1ee01c9404b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:54.394044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693438-372b-4f6f-a6df-1ee01c9404b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:54.395677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693438-372b-4f6f-a6df-1ee01c9404b7 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:54.407154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 890/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:58.572859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:58.575505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:58.590171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:58.676224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2bb93-8815-4e31-b4f6-f56fd04f99ec None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:58.676791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2bb93-8815-4e31-b4f6-f56fd04f99ec None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:58.676791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2bb93-8815-4e31-b4f6-f56fd04f99ec None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:58.678163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 891/1771] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:35:58.717167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76146a29-d2bf-434e-94be-ad9afffa3c48 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:58.717454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76146a29-d2bf-434e-94be-ad9afffa3c48 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:58.717718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76146a29-d2bf-434e-94be-ad9afffa3c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:58.738166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42276b-6bd8-4488-8b1c-a262b6c25809 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:58.746086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:58.748067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:58.748667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:58.749338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] PATH_INFO: `/v3/users/a01e12758bf64b609a9db720f7da6bc2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:58.751084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01e12758bf64b609a9db720f7da6bc2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:58.753357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:58.757880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-76146a29-d2bf-434e-94be-ad9afffa3c48 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:58.759132 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-76146a29-d2bf-434e-94be-ad9afffa3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:58.792465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:58.835681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01e12758bf64b609a9db720f7da6bc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:58.846754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01e12758bf64b609a9db720f7da6bc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:58.848125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01e12758bf64b609a9db720f7da6bc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:58.849016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01e12758bf64b609a9db720f7da6bc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:58.879635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01e12758bf64b609a9db720f7da6bc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:35:58.901193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 892/1772] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:35:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:58.905313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 881/1773] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:35:58 2022] DELETE /identity/v3/users/a01e12758bf64b609a9db720f7da6bc2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:35:58.919597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:58.919885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:58.922916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:58.958036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:58.960154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:58.976835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:58.979270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:59.120970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 893/1774] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:59.157283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914b111-db02-485d-8f03-7d7e5cdb147e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:59.165926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:59.166571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:59.166844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:59.167167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:59.182972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:59.185131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:59.186619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:59.187016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:59.213441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 882/1775] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:35:59.277051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bdbd1-26b0-484b-b547-27000e8bfcc9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:59.283196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:59.284494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:59.284982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:59.285515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:59.307627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:59.310643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:59.325934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 894/1776] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:00.957835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:00.959307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:00.992599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795c688-fd25-48a3-87d8-b6bab05eeae8 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:01.030042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:01.030905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:01.034804 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:01.035180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] PATH_INFO: `/v3/projects/14c7024b3bff446f8313398d6fe59a4a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:01.038574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c7024b3bff446f8313398d6fe59a4a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:01.042757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:01.077595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:01.188650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c7024b3bff446f8313398d6fe59a4a', 'request_id': 'req-3d58d606-f7ec-4f87-8812-7bb52155712f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.208340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c7024b3bff446f8313398d6fe59a4a', 'request_id': 'req-3d58d606-f7ec-4f87-8812-7bb52155712f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.218636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c7024b3bff446f8313398d6fe59a4a', 'request_id': 'req-3d58d606-f7ec-4f87-8812-7bb52155712f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.242129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] The token cache is being invalidate because project 14c7024b3bff446f8313398d6fe59a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:01.242559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.243421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3d58d606-f7ec-4f87-8812-7bb52155712f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.246454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 883/1777] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:00 2022] DELETE /identity/v3/projects/14c7024b3bff446f8313398d6fe59a4a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:01.251189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:01.266468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f59a-c2e1-4f4b-8b63-68b0ed7dfdf6 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:01.361898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:01.362869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:01.363211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:01.363590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] PATH_INFO: `/v3/users/f7e095f0388b415991ca1152d181e399` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:01.365036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e095f0388b415991ca1152d181e399)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:01.367913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:01.370647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:01.506592 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e095f0388b415991ca1152d181e399'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.507675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e095f0388b415991ca1152d181e399'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.524771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e095f0388b415991ca1152d181e399'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.540568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e095f0388b415991ca1152d181e399'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.541409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cb8a2607-4e7e-4259-9a16-7d83dfb67db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e095f0388b415991ca1152d181e399'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:01.592340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 895/1778] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:01 2022] DELETE /identity/v3/users/f7e095f0388b415991ca1152d181e399 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:02.038272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195c07-6f23-4069-8772-ee5253c254f8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:02.039477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195c07-6f23-4069-8772-ee5253c254f8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:02.039953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195c07-6f23-4069-8772-ee5253c254f8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:02.042173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 884/1779] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:36:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:02.049962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:02.050314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:02.050505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:02.091484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:02.092935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:02.187266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 896/1780] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:36:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:02.201316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d195c07-6f23-4069-8772-ee5253c254f8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:02.203676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9d195c07-6f23-4069-8772-ee5253c254f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:02.240577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d195c07-6f23-4069-8772-ee5253c254f8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:02.247844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66ece8-2fba-4d6b-a58a-5d27a670f286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:02.248387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ece8-2fba-4d6b-a58a-5d27a670f286 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:02.248661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ece8-2fba-4d6b-a58a-5d27a670f286 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:02.249019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ece8-2fba-4d6b-a58a-5d27a670f286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:02.262939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66ece8-2fba-4d6b-a58a-5d27a670f286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:02.264641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66ece8-2fba-4d6b-a58a-5d27a670f286 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:02.279541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 885/1781] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:36:03.364665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:03.367448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:03.511606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2edf-aefe-42f7-915f-896c0da82be2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:03.518126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:03.519104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:03.519527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:03.520072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] PATH_INFO: `/v3/projects/324fd546dc32477e97dcc3e70cf4af9f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:03.521662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324fd546dc32477e97dcc3e70cf4af9f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:03.523688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:03.539501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:03.590301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324fd546dc32477e97dcc3e70cf4af9f', 'request_id': 'req-a2eac7de-be20-4b47-93fe-0aab519c68d3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:03.605129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324fd546dc32477e97dcc3e70cf4af9f', 'request_id': 'req-a2eac7de-be20-4b47-93fe-0aab519c68d3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:03.622654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324fd546dc32477e97dcc3e70cf4af9f', 'request_id': 'req-a2eac7de-be20-4b47-93fe-0aab519c68d3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:03.653995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] The token cache is being invalidate because project 324fd546dc32477e97dcc3e70cf4af9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:03.654552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:03.655424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a2eac7de-be20-4b47-93fe-0aab519c68d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:03.659186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 897/1782] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:03 2022] DELETE /identity/v3/projects/324fd546dc32477e97dcc3e70cf4af9f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:03.665027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f63615-8975-447f-9f7c-f00a630c9146 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:03.666807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f63615-8975-447f-9f7c-f00a630c9146 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:03.667295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f63615-8975-447f-9f7c-f00a630c9146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:03.693106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e8f63615-8975-447f-9f7c-f00a630c9146 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:03.696815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e8f63615-8975-447f-9f7c-f00a630c9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:03.798841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 886/1783] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:03.799311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d8649-6b2c-4912-affa-2bf5a93dd5ef None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:03.799659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d8649-6b2c-4912-affa-2bf5a93dd5ef None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:03.799936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d8649-6b2c-4912-affa-2bf5a93dd5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:03.830956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a15d8649-6b2c-4912-affa-2bf5a93dd5ef None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:03.832265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a15d8649-6b2c-4912-affa-2bf5a93dd5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:03.841477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 898/1784] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:03.846056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f63615-8975-447f-9f7c-f00a630c9146 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:03.856863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f63615-8975-447f-9f7c-f00a630c9146 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:03.861837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:03.862650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:03.863094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:03.863505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:03.864288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:03.864729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:03.867282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:03.881204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 887/1785] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:03.886371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d8649-6b2c-4912-affa-2bf5a93dd5ef None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:03.904315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d8649-6b2c-4912-affa-2bf5a93dd5ef None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:03.914754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:03.915776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:03.916187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:03.916721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:03.917551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:03.921280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:03.970499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 899/1786] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:03 2022] POST /identity/v3/projects => generated 391 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:36:03.972940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:03.984615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aba38-66aa-4b82-97c3-cda26f829107 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:04.124264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:04.124913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:04.125173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:04.125443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:04.126282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:04.131416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:04.169093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:04.185776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 888/1787] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:03 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:04.187954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:04.201927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049585a-03c5-42f9-ae90-97f6ad01c342 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:04.208640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:04.209618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:04.209923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:04.210363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:04.211120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:04.213816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:04.236785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 900/1788] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:04.237472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:04.250044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d26e7-042d-4c00-920c-fff0c3a1df89 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:04.257409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226dac2-f050-4cd6-a416-d521a0fd60fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:04.258588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226dac2-f050-4cd6-a416-d521a0fd60fa admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:04.258934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226dac2-f050-4cd6-a416-d521a0fd60fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:04.259400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226dac2-f050-4cd6-a416-d521a0fd60fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:04.260547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226dac2-f050-4cd6-a416-d521a0fd60fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:04.264808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226dac2-f050-4cd6-a416-d521a0fd60fa admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:04.288537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 889/1789] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:04.289237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:04.313193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70b28e-2c13-433d-bba6-d39983e16ca6 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:04.318661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:04.319575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:04.319881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:04.320205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] PATH_INFO: `/v3/projects/fa2d4544d35d492b9959ef271034017b/users/f490ec1f209d4b8a986cb51f69b0cafc/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:04.345248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2d4544d35d492b9959ef271034017b, user_id=f490ec1f209d4b8a986cb51f69b0cafc, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:04.350288 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:04.382087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 901/1790] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:04 2022] PUT /identity/v3/projects/fa2d4544d35d492b9959ef271034017b/users/f490ec1f209d4b8a986cb51f69b0cafc/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:04.395085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a545e-3cf8-4068-b005-8a89de9591ea None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:04.395428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a545e-3cf8-4068-b005-8a89de9591ea None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:04.395742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a545e-3cf8-4068-b005-8a89de9591ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:04.437753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-437a545e-3cf8-4068-b005-8a89de9591ea None None] MFA Rules not processed for user `f490ec1f209d4b8a986cb51f69b0cafc`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:04.440983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-437a545e-3cf8-4068-b005-8a89de9591ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:04.625039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 890/1791] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:04.630107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:04.819427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eea550-a960-45d7-9db0-712fcf4c043c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:04.833544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:04.835000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:04.835373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:04.835736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:04.836481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:04.840763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:04.911125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 902/1792] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:04 2022] POST /identity/v3/projects => generated 393 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:04.915587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a545e-3cf8-4068-b005-8a89de9591ea None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:04.929929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a545e-3cf8-4068-b005-8a89de9591ea None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:05.024915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:05.026338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.028661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.029136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.030541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:05.034928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:05.076492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 891/1793] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:04 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:05.080371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:05.092072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b7472-74eb-41ca-aa17-62a2fd07ac0e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:05.098187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:05.098820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.099090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.099353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.100173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:05.101962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:05.116669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 903/1794] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:05.120883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:05.140599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bcb1c-844f-40d8-96bb-36a39dd0a4b0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:05.146277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:05.147004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.147286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.147558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] PATH_INFO: `/v3/projects/8f2aefe5b70b4c16930fe964283f0c09/users/57b26105fffc455d9eed5e163fa16752/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.171245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2aefe5b70b4c16930fe964283f0c09, user_id=57b26105fffc455d9eed5e163fa16752, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:05.176773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:05.208623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 892/1795] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:05 2022] PUT /identity/v3/projects/8f2aefe5b70b4c16930fe964283f0c09/users/57b26105fffc455d9eed5e163fa16752/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:05.212991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:05.229783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f8be8-6a7e-4ba1-a579-86b9a8568804 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:05.251254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:05.368858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ca161-03e0-4017-b977-aaf2cebcd6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:05.369496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ca161-03e0-4017-b977-aaf2cebcd6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.369772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ca161-03e0-4017-b977-aaf2cebcd6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.370132 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ca161-03e0-4017-b977-aaf2cebcd6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.371960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ca161-03e0-4017-b977-aaf2cebcd6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:05.377496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ca161-03e0-4017-b977-aaf2cebcd6e1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:05.403457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 904/1796] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:05.405937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:05.423172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6764a-603f-46fb-b95c-69c3aa02a0ff admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:05.429301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:05.430094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.431098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.431098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] PATH_INFO: `/v3/projects/8f2aefe5b70b4c16930fe964283f0c09/users/57b26105fffc455d9eed5e163fa16752/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.437946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2aefe5b70b4c16930fe964283f0c09, user_id=57b26105fffc455d9eed5e163fa16752, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:05.442873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:05.459230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 893/1797] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:05 2022] PUT /identity/v3/projects/8f2aefe5b70b4c16930fe964283f0c09/users/57b26105fffc455d9eed5e163fa16752/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:05.476248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e1a9-22a9-48e0-be0d-7979db895667 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.476375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e1a9-22a9-48e0-be0d-7979db895667 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.476577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e1a9-22a9-48e0-be0d-7979db895667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.537727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d8c0e1a9-22a9-48e0-be0d-7979db895667 None None] MFA Rules not processed for user `57b26105fffc455d9eed5e163fa16752`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:05.539252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d8c0e1a9-22a9-48e0-be0d-7979db895667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:05.638156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:05.640131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:05.702307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 905/1798] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:05.704075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:05.785064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e1a9-22a9-48e0-be0d-7979db895667 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:05.809082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e1a9-22a9-48e0-be0d-7979db895667 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:05.809478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a0b29-16cb-46cb-b1e6-e340d36f8342 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:05.814338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17f095-5eca-4970-aea5-72c32df16df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:05.815084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17f095-5eca-4970-aea5-72c32df16df3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.815453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17f095-5eca-4970-aea5-72c32df16df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.815896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:05.816045 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17f095-5eca-4970-aea5-72c32df16df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.816666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:05.816928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:05.817192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:05.819754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af17f095-5eca-4970-aea5-72c32df16df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:05.828630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:05.830651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:05.871035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 906/1799] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:36:05.982175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17f095-5eca-4970-aea5-72c32df16df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:05.983833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17f095-5eca-4970-aea5-72c32df16df3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:06.004779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 894/1800] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:14.241725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:14.332132 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49299-1b65-4213-a1ca-98e7bd3d96e6 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:14.336854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:14.337491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:14.337748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:14.338152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] PATH_INFO: `/v3/users/f490ec1f209d4b8a986cb51f69b0cafc` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:14.339562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f490ec1f209d4b8a986cb51f69b0cafc)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:14.341601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:14.385661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:14.467817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f490ec1f209d4b8a986cb51f69b0cafc'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:14.468473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f490ec1f209d4b8a986cb51f69b0cafc'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:14.498536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f490ec1f209d4b8a986cb51f69b0cafc'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:14.510628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f490ec1f209d4b8a986cb51f69b0cafc'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:14.511833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f490ec1f209d4b8a986cb51f69b0cafc'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:14.544961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 907/1801] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:14 2022] DELETE /identity/v3/users/f490ec1f209d4b8a986cb51f69b0cafc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:14.546483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:14.547312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:14.547617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:14.602013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:14.603638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:14.763513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 895/1802] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:14.842970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:14.844435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:14.937832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad056b13-fe88-4835-96cb-182e6d8e8488 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:14.942495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:14.943402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:14.943885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:14.944327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:14.957606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:14.959725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:14.975342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 908/1803] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:16.575370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:16.576832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:16.599369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d083-15a0-425a-81bd-7cbb9515da5f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:16.615737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:16.616414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:16.616686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:16.616964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] PATH_INFO: `/v3/projects/fa2d4544d35d492b9959ef271034017b` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:16.623490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2d4544d35d492b9959ef271034017b)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:16.625107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:16.718905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2d4544d35d492b9959ef271034017b', 'request_id': 'req-d9b88514-9972-4de0-a7a8-a51e2a9c23de'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.734821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2d4544d35d492b9959ef271034017b', 'request_id': 'req-d9b88514-9972-4de0-a7a8-a51e2a9c23de'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.747136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2d4544d35d492b9959ef271034017b', 'request_id': 'req-d9b88514-9972-4de0-a7a8-a51e2a9c23de'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.773394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] The token cache is being invalidate because project fa2d4544d35d492b9959ef271034017b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:16.773896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.774640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.778075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 896/1804] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:16 2022] DELETE /identity/v3/projects/fa2d4544d35d492b9959ef271034017b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:16.781875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:16.792248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b45a-25aa-482f-99ff-cbfaebf0e0a4 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:16.864017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:16.864722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:16.865001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:16.865270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] PATH_INFO: `/v3/users/57b26105fffc455d9eed5e163fa16752` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:16.866524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b26105fffc455d9eed5e163fa16752)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:16.868602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:16.934347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:16.937706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b26105fffc455d9eed5e163fa16752'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.938535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b26105fffc455d9eed5e163fa16752'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.959050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b26105fffc455d9eed5e163fa16752'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.971729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b26105fffc455d9eed5e163fa16752'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:16.973586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6afe93cb-dfb5-437e-82d1-f9e5004da39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b26105fffc455d9eed5e163fa16752'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:17.000700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 909/1805] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:16 2022] DELETE /identity/v3/users/57b26105fffc455d9eed5e163fa16752 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:17.744913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:17.747651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:17.763320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b88514-9972-4de0-a7a8-a51e2a9c23de admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:17.769944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:17.851873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:17.852647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:17.852995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:17.853357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] PATH_INFO: `/v3/projects/8f2aefe5b70b4c16930fe964283f0c09` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:17.854616 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2aefe5b70b4c16930fe964283f0c09)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:17.857069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:17.920036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2aefe5b70b4c16930fe964283f0c09', 'request_id': 'req-5cbac88e-b2c4-4b11-96c7-2854f0c93779'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:17.929932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2aefe5b70b4c16930fe964283f0c09', 'request_id': 'req-5cbac88e-b2c4-4b11-96c7-2854f0c93779'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:17.938591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2aefe5b70b4c16930fe964283f0c09', 'request_id': 'req-5cbac88e-b2c4-4b11-96c7-2854f0c93779'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:17.958446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] The token cache is being invalidate because project 8f2aefe5b70b4c16930fe964283f0c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:17.959282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:17.960400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5cbac88e-b2c4-4b11-96c7-2854f0c93779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:17.963121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 897/1806] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:17 2022] DELETE /identity/v3/projects/8f2aefe5b70b4c16930fe964283f0c09 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:17.978732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642819-c12e-4bf7-a9e8-3d8f0554be94 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:17.979746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642819-c12e-4bf7-a9e8-3d8f0554be94 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:17.980048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642819-c12e-4bf7-a9e8-3d8f0554be94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.030056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e0642819-c12e-4bf7-a9e8-3d8f0554be94 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:18.031772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e0642819-c12e-4bf7-a9e8-3d8f0554be94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:18.180249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 910/1807] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:18.180800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c416-fcf7-4f96-bbbd-33b46028bd46 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.181110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c416-fcf7-4f96-bbbd-33b46028bd46 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.181439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c416-fcf7-4f96-bbbd-33b46028bd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.211077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5582c416-fcf7-4f96-bbbd-33b46028bd46 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:18.212660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5582c416-fcf7-4f96-bbbd-33b46028bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:18.233318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 898/1808] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:18.234709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0642819-c12e-4bf7-a9e8-3d8f0554be94 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:18.247286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0642819-c12e-4bf7-a9e8-3d8f0554be94 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:18.253918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:18.254698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.255011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.255323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.256039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:18.256392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:18.258593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:18.280994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 911/1809] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:18.285744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582c416-fcf7-4f96-bbbd-33b46028bd46 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:18.306595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582c416-fcf7-4f96-bbbd-33b46028bd46 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:18.317917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:18.319748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.320077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.320916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.321874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:18.324291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:18.361904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 899/1810] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:18 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:18.366703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:18.384912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e57fc8-4e95-4686-9ef3-92a7dfc3150c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:18.450499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:18.451133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.451437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.451674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.452317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:18.454539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:18.486204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 912/1811] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:18 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:18.487838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:18.499271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566ee57-08ae-4d04-9522-df24d41758f8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:18.504846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:18.505477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.505751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.506049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.506690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:18.508337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:18.522927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 900/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:18.524536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:18.536985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432b0b-0560-4551-a55b-86f381946e83 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:18.541689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f384eb-1121-41fa-9a63-cba08ef50d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:18.542738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f384eb-1121-41fa-9a63-cba08ef50d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.543015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f384eb-1121-41fa-9a63-cba08ef50d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.543458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f384eb-1121-41fa-9a63-cba08ef50d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.544114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f384eb-1121-41fa-9a63-cba08ef50d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:18.545875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f384eb-1121-41fa-9a63-cba08ef50d16 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:18.565123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 913/1813] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:18.566631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:18.579460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a544b-fd47-4020-8ee6-1720bfe8d572 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:18.586417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:18.587400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.587854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.588375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] PATH_INFO: `/v3/projects/867288b1795d4cb080812d3da9d4016d/users/abe7307ca69849c983a08bb6cf627e99/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.616978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867288b1795d4cb080812d3da9d4016d, user_id=abe7307ca69849c983a08bb6cf627e99, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:18.621284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:18.665296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 901/1814] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:18 2022] PUT /identity/v3/projects/867288b1795d4cb080812d3da9d4016d/users/abe7307ca69849c983a08bb6cf627e99/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:18.667265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.667601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.667859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.698199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] MFA Rules not processed for user `abe7307ca69849c983a08bb6cf627e99`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:18.700113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:18.715567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:18.779577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 914/1815] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:18.798151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:18.803194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:18.885171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:18.910821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2a756-3c55-405e-b395-0de6ad3343a2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:18.919945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836bee7-378a-4fdf-b57b-190809191117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:18.920961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836bee7-378a-4fdf-b57b-190809191117 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:18.921440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836bee7-378a-4fdf-b57b-190809191117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:18.922123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836bee7-378a-4fdf-b57b-190809191117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:18.935481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836bee7-378a-4fdf-b57b-190809191117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:18.937774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836bee7-378a-4fdf-b57b-190809191117 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:18.949527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 902/1816] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:23.099299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:23.101738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:23.184208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb8cc-d343-4da6-aa80-7dce3000ea31 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:23.189250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:23.189725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:23.190458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:23.190587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] PATH_INFO: `/v3/users/af4e2b7eee0c405898f836d492173fc7` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:23.191964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4e2b7eee0c405898f836d492173fc7)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:23.193829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:23.258165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4e2b7eee0c405898f836d492173fc7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.259002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4e2b7eee0c405898f836d492173fc7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.274643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4e2b7eee0c405898f836d492173fc7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.291134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4e2b7eee0c405898f836d492173fc7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.291947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4e2b7eee0c405898f836d492173fc7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.312314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 915/1817] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:23 2022] DELETE /identity/v3/users/af4e2b7eee0c405898f836d492173fc7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:23.316582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:23.321250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:23.321547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:23.346454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:23.347697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:23.417047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 903/1818] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:23.429936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:23.431681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:23.496822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:23.525052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e74f78-88ef-4868-96d2-93c2068d0258 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:23.534374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f033cc-ce1d-44c5-8716-b977762314d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:23.534957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f033cc-ce1d-44c5-8716-b977762314d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:23.535290 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f033cc-ce1d-44c5-8716-b977762314d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:23.535650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f033cc-ce1d-44c5-8716-b977762314d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:23.546010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f033cc-ce1d-44c5-8716-b977762314d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:23.547613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f033cc-ce1d-44c5-8716-b977762314d1 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:23.559366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 916/1819] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:23.816554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:23.818628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:23.832731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3aa546-1ae4-43fa-aa8a-349e9f3df0c6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:23.843307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:23.843536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:23.843667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:23.843887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] PATH_INFO: `/v3/projects/eff09cdd6cca450d8f76d57937193e45` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:23.845160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff09cdd6cca450d8f76d57937193e45)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:23.847203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:23.940689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff09cdd6cca450d8f76d57937193e45', 'request_id': 'req-e77afb8f-0ddf-490b-86a2-833696050ab1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.950667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff09cdd6cca450d8f76d57937193e45', 'request_id': 'req-e77afb8f-0ddf-490b-86a2-833696050ab1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.959207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff09cdd6cca450d8f76d57937193e45', 'request_id': 'req-e77afb8f-0ddf-490b-86a2-833696050ab1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.977277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] The token cache is being invalidate because project eff09cdd6cca450d8f76d57937193e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:23.977641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.978323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e77afb8f-0ddf-490b-86a2-833696050ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:23.980304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 904/1820] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:23 2022] DELETE /identity/v3/projects/eff09cdd6cca450d8f76d57937193e45 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:23.985492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab417e-7556-46dd-b238-d95ca17cf7bd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:23.986711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab417e-7556-46dd-b238-d95ca17cf7bd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:23.986711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab417e-7556-46dd-b238-d95ca17cf7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.023277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e2ab417e-7556-46dd-b238-d95ca17cf7bd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:24.026744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e2ab417e-7556-46dd-b238-d95ca17cf7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:24.150530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 917/1821] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:24.159528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf5ef-047c-4221-89bf-d64a3c8d456f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.159945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf5ef-047c-4221-89bf-d64a3c8d456f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.160343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf5ef-047c-4221-89bf-d64a3c8d456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.189622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e2baf5ef-047c-4221-89bf-d64a3c8d456f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:24.195477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e2baf5ef-047c-4221-89bf-d64a3c8d456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:24.211860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab417e-7556-46dd-b238-d95ca17cf7bd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:24.218327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 905/1822] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:24.225813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab417e-7556-46dd-b238-d95ca17cf7bd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:24.231862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:24.232504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.232787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.233221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.233930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:24.234474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:24.236622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:24.269527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baf5ef-047c-4221-89bf-d64a3c8d456f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:24.270906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 918/1823] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:24.303849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baf5ef-047c-4221-89bf-d64a3c8d456f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:24.318443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:24.319544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.321190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.322789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.323726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:24.332525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:24.382916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 906/1824] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:24 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:36:24.388896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:24.401336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1058550-ef33-4f26-8306-739916a1058b admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:24.546981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:24.552940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.553310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.556188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.556897 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:24.559834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:24.640415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 919/1825] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:24 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:24.644833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:24.661508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517cebe-35d3-4d29-b229-025ddc7bd299 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:24.678243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:24.678931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.679321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.693771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.695841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:24.703546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:24.723083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:24.729159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 907/1826] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:24.739392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45867-c38e-49af-8142-ab5e7c555116 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:24.761742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9353-fc4f-41b1-b548-9be012ef91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:24.762403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9353-fc4f-41b1-b548-9be012ef91e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.763001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9353-fc4f-41b1-b548-9be012ef91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.763001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9353-fc4f-41b1-b548-9be012ef91e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.763577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c9353-fc4f-41b1-b548-9be012ef91e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:24.765188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c9353-fc4f-41b1-b548-9be012ef91e5 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:24.788501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 920/1827] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:24.793708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:24.813162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ac6dc-f866-42b5-8e64-539a6c9445c4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:24.814749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:24.815663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.816019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.816229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] PATH_INFO: `/v3/projects/66a7ade0ed314944ab201f6dc24f8a32/users/fd7a3869d36943139ea86734e8eb1e09/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.852813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a7ade0ed314944ab201f6dc24f8a32, user_id=fd7a3869d36943139ea86734e8eb1e09, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:24.856844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:24.874343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:24.906080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802969df-878a-4ab5-a1fd-9eb0e68124cc None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:24.906866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802969df-878a-4ab5-a1fd-9eb0e68124cc None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:24.907238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802969df-878a-4ab5-a1fd-9eb0e68124cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:24.911144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 908/1828] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:24 2022] PUT /identity/v3/projects/66a7ade0ed314944ab201f6dc24f8a32/users/fd7a3869d36943139ea86734e8eb1e09/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:24.950551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-802969df-878a-4ab5-a1fd-9eb0e68124cc None None] MFA Rules not processed for user `fd7a3869d36943139ea86734e8eb1e09`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:24.952096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-802969df-878a-4ab5-a1fd-9eb0e68124cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:25.007400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:25.069866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 921/1829] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:25.121321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:25.123736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:25.244387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11e8b-af7f-4d49-978d-72fc39c52165 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:25.248707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db067f3-e794-4de9-bf2a-2e0a0e847b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:25.249344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db067f3-e794-4de9-bf2a-2e0a0e847b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:25.249621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db067f3-e794-4de9-bf2a-2e0a0e847b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:25.249917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db067f3-e794-4de9-bf2a-2e0a0e847b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:25.278851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db067f3-e794-4de9-bf2a-2e0a0e847b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:25.280443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db067f3-e794-4de9-bf2a-2e0a0e847b11 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:25.295346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 909/1830] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:26.859803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802969df-878a-4ab5-a1fd-9eb0e68124cc None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:26.967675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802969df-878a-4ab5-a1fd-9eb0e68124cc None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:26.975511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:26.976487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:26.976915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:26.977331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] PATH_INFO: `/v3/users/fd7a3869d36943139ea86734e8eb1e09` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:26.980565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7a3869d36943139ea86734e8eb1e09)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:26.983669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:27.072363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7a3869d36943139ea86734e8eb1e09'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:27.073717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7a3869d36943139ea86734e8eb1e09'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:27.113921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7a3869d36943139ea86734e8eb1e09'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:27.124090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7a3869d36943139ea86734e8eb1e09'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:27.125000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7a3869d36943139ea86734e8eb1e09'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:27.141863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 922/1831] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:26 2022] DELETE /identity/v3/users/fd7a3869d36943139ea86734e8eb1e09 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:27.145901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:27.147216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:27.147844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:27.174296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:27.176065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:27.255036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 910/1832] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:27.279660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:27.281164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:27.365253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694ee72-fbd2-4b6d-b2e8-f43aa1992fa8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:27.369373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42ee4f-5a0f-4ef3-ade2-fe9e6f11f3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:27.369682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ee4f-5a0f-4ef3-ade2-fe9e6f11f3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:27.370063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ee4f-5a0f-4ef3-ade2-fe9e6f11f3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:27.370513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ee4f-5a0f-4ef3-ade2-fe9e6f11f3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:27.380481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:27.383035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42ee4f-5a0f-4ef3-ade2-fe9e6f11f3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:27.385922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42ee4f-5a0f-4ef3-ade2-fe9e6f11f3b6 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:27.413928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 923/1833] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:28.460457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:28.462630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:28.476488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668ad6-7e64-40bd-a577-3dfde79507dc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:28.481498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:28.482153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:28.482628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:28.482874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] PATH_INFO: `/v3/projects/66a7ade0ed314944ab201f6dc24f8a32` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:28.484449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a7ade0ed314944ab201f6dc24f8a32)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:28.486440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:28.551106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a7ade0ed314944ab201f6dc24f8a32', 'request_id': 'req-5475f3c8-b6cd-449b-a676-0bc2d5be5210'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:28.558038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a7ade0ed314944ab201f6dc24f8a32', 'request_id': 'req-5475f3c8-b6cd-449b-a676-0bc2d5be5210'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:28.564410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a7ade0ed314944ab201f6dc24f8a32', 'request_id': 'req-5475f3c8-b6cd-449b-a676-0bc2d5be5210'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:28.580433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] The token cache is being invalidate because project 66a7ade0ed314944ab201f6dc24f8a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:28.580908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:28.581711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5475f3c8-b6cd-449b-a676-0bc2d5be5210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:28.583531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 911/1834] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:28 2022] DELETE /identity/v3/projects/66a7ade0ed314944ab201f6dc24f8a32 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:28.588332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c997-d9e4-4144-9852-2e6b60267ff6 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:28.588870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c997-d9e4-4144-9852-2e6b60267ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:28.588953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c997-d9e4-4144-9852-2e6b60267ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:28.609648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5110c997-d9e4-4144-9852-2e6b60267ff6 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:28.610972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5110c997-d9e4-4144-9852-2e6b60267ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:28.695513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 924/1835] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:28.703372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb129c-55ef-4c1f-9ba1-f774a35ae98f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:28.703687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb129c-55ef-4c1f-9ba1-f774a35ae98f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:28.703961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb129c-55ef-4c1f-9ba1-f774a35ae98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:28.742378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-17fb129c-55ef-4c1f-9ba1-f774a35ae98f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:28.742378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-17fb129c-55ef-4c1f-9ba1-f774a35ae98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:28.753264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 912/1836] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:28.754258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c997-d9e4-4144-9852-2e6b60267ff6 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:28.765207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c997-d9e4-4144-9852-2e6b60267ff6 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:28.774900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:28.775542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:28.775812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:28.776073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:28.776831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:28.777137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:28.778832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:28.801085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 925/1837] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:28.806009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb129c-55ef-4c1f-9ba1-f774a35ae98f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:28.816362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb129c-55ef-4c1f-9ba1-f774a35ae98f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:28.823767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:28.825390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:28.826687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:28.827570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:28.828431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:28.831656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:28.857659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:28.886268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 913/1838] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:28 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:28.891013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:28.903543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f67f6-2f0c-44c7-b30c-27dcc1166dcb admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:28.908214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:28.909987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:29.001312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.002207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.003068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.003555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.004404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.007735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.008667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347692b-2041-4004-8f16-f18c56fe396b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:29.015174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.015935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.016106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.016381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] PATH_INFO: `/v3/users/b691bda26f954b579009aae9dd6cb2ed` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.017682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b691bda26f954b579009aae9dd6cb2ed)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.019743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.049013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 926/1839] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:28 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:29.055106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:29.073621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae55b0-aa2e-4375-b5ea-cc74ebffa469 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:29.096806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.098738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.100161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.100487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.102418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.106559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.107274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b691bda26f954b579009aae9dd6cb2ed'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:29.120088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b691bda26f954b579009aae9dd6cb2ed'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:29.120916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b691bda26f954b579009aae9dd6cb2ed'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:29.126624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b691bda26f954b579009aae9dd6cb2ed'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:29.137781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 927/1840] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:29.140002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:29.142073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:29.144679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d382c90e-e206-4659-8d13-3a441f8c5a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b691bda26f954b579009aae9dd6cb2ed'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:29.165930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c069-d415-41a8-a1b5-0cb1539f015d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:29.173294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.173294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.173294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.173294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.174030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.175722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.189624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 928/1841] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:29.195965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:29.202182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 914/1842] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:28 2022] DELETE /identity/v3/users/b691bda26f954b579009aae9dd6cb2ed => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:29.211264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.211864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.213633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.221118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63333f6b-a507-467a-8465-81d8122cdbbd admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:29.260275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:29.261715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:29.341353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:29.358683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06461-0bc6-4324-b094-41a3986010c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.359558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06461-0bc6-4324-b094-41a3986010c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.359930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06461-0bc6-4324-b094-41a3986010c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.360300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06461-0bc6-4324-b094-41a3986010c7 admin admin] PATH_INFO: `/v3/projects/4efd390fd59e4d73ac77b167d50f0c45/users/9b90414ecea144f3bebd7f7fdec6259e/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.383076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a06461-0bc6-4324-b094-41a3986010c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efd390fd59e4d73ac77b167d50f0c45, user_id=9b90414ecea144f3bebd7f7fdec6259e, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.387027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a06461-0bc6-4324-b094-41a3986010c7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.413937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 929/1843] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:29 2022] PUT /identity/v3/projects/4efd390fd59e4d73ac77b167d50f0c45/users/9b90414ecea144f3bebd7f7fdec6259e/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:29.424496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.425404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 915/1844] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:29.426312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.426606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.468327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] MFA Rules not processed for user `9b90414ecea144f3bebd7f7fdec6259e`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:29.469586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:29.471116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:29.473321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:29.508266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:29.599986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b84e-f27d-4ee3-bd8e-3b7d8d92a10b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:29.600512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 930/1845] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:29.617844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:29.619551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:29.675254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.675788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.676058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.676321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.712471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70a40-e5e3-4d2d-ac10-2986c980d9a2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:29.718863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:29.722079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:29.723704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:29.723704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:29.754912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.756797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.771229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 931/1846] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:29.796918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:29.798453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:29.810588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 916/1847] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:30.507091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:30.509347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:30.527079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e31f8-e045-46d3-8175-af37ff20d658 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:30.535017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:30.535865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:30.536137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:30.536402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] PATH_INFO: `/v3/projects/6116940d1a964738930d52f2e36d6fd0` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:30.537551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6116940d1a964738930d52f2e36d6fd0)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:30.540780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:30.628694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6116940d1a964738930d52f2e36d6fd0', 'request_id': 'req-ad5ec907-f112-4b3a-99e5-545a2189a23a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.639043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6116940d1a964738930d52f2e36d6fd0', 'request_id': 'req-ad5ec907-f112-4b3a-99e5-545a2189a23a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.641788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:30.655102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6116940d1a964738930d52f2e36d6fd0', 'request_id': 'req-ad5ec907-f112-4b3a-99e5-545a2189a23a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.678819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] The token cache is being invalidate because project 6116940d1a964738930d52f2e36d6fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:30.679322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.680378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.683146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 932/1848] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:30 2022] DELETE /identity/v3/projects/6116940d1a964738930d52f2e36d6fd0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:30.686766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:30.716769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e495dc-794d-4fa9-902c-7b734c451652 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:30.861492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:30.862673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:30.863132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:30.863544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] PATH_INFO: `/v3/users/f1c981a752554cf6968581ca81e7b75c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:30.865043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c981a752554cf6968581ca81e7b75c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:30.869098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:30.898594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:30.957105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c981a752554cf6968581ca81e7b75c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.969450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c981a752554cf6968581ca81e7b75c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.971076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c981a752554cf6968581ca81e7b75c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:30.972242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c981a752554cf6968581ca81e7b75c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:31.007449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c981a752554cf6968581ca81e7b75c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:31.033850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 917/1849] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:30 2022] DELETE /identity/v3/users/f1c981a752554cf6968581ca81e7b75c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:31.965846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:31.968116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:31.983145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ec907-f112-4b3a-99e5-545a2189a23a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:32.093238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:32.093958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:32.094233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:32.094502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] PATH_INFO: `/v3/projects/3b4fd059282b4034975c23488432a837` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:32.095742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4fd059282b4034975c23488432a837)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:32.098495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:32.164570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4fd059282b4034975c23488432a837', 'request_id': 'req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.172837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4fd059282b4034975c23488432a837', 'request_id': 'req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.186535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4fd059282b4034975c23488432a837', 'request_id': 'req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.205750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] The token cache is being invalidate because project 3b4fd059282b4034975c23488432a837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:32.206215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.207133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.209007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 933/1850] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:31 2022] DELETE /identity/v3/projects/3b4fd059282b4034975c23488432a837 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:32.214171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:32.217779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:32.261469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d303d-82a7-4c6f-bb24-1f292d5b6119 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:32.409725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:32.410410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:32.410681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:32.410947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] PATH_INFO: `/v3/users/af450338fdd04aa798dcaef8fcd28ad3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:32.412110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af450338fdd04aa798dcaef8fcd28ad3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:32.414944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:32.494679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af450338fdd04aa798dcaef8fcd28ad3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.505926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af450338fdd04aa798dcaef8fcd28ad3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.506404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af450338fdd04aa798dcaef8fcd28ad3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.507179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af450338fdd04aa798dcaef8fcd28ad3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.524529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1e67f9b3-6e07-4c0b-a420-3818cdac0422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af450338fdd04aa798dcaef8fcd28ad3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:32.569741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 918/1851] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:32 2022] DELETE /identity/v3/users/af450338fdd04aa798dcaef8fcd28ad3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:33.702772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:33.702772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:33.717660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d653ce-20bf-4c16-8c0d-4cddd6a32949 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:33.806334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:33.808872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:33.809366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:33.810186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] PATH_INFO: `/v3/projects/6bc6d7d74146446bb790c55e256793d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:33.811806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc6d7d74146446bb790c55e256793d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:33.815244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:33.877016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:33.916462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc6d7d74146446bb790c55e256793d2', 'request_id': 'req-280ceecc-71bc-44a0-a099-5c9a8a024c00'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:33.930250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc6d7d74146446bb790c55e256793d2', 'request_id': 'req-280ceecc-71bc-44a0-a099-5c9a8a024c00'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:33.942408 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc6d7d74146446bb790c55e256793d2', 'request_id': 'req-280ceecc-71bc-44a0-a099-5c9a8a024c00'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:33.973047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] The token cache is being invalidate because project 6bc6d7d74146446bb790c55e256793d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:33.973496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:33.983913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-280ceecc-71bc-44a0-a099-5c9a8a024c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:34.001893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 934/1852] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:33 2022] DELETE /identity/v3/projects/6bc6d7d74146446bb790c55e256793d2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:34.002423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26843aad-d49e-4f05-a00f-74ffd6f68e00 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.002895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26843aad-d49e-4f05-a00f-74ffd6f68e00 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.002987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26843aad-d49e-4f05-a00f-74ffd6f68e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.037714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-26843aad-d49e-4f05-a00f-74ffd6f68e00 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:34.039121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26843aad-d49e-4f05-a00f-74ffd6f68e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:34.055668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:34.138673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 919/1853] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:34.146333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2d457-cd59-4c47-ab0c-4d83affc9916 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.146806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2d457-cd59-4c47-ab0c-4d83affc9916 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.147467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2d457-cd59-4c47-ab0c-4d83affc9916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.170572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-75b2d457-cd59-4c47-ab0c-4d83affc9916 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:34.171960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-75b2d457-cd59-4c47-ab0c-4d83affc9916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:34.181251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 935/1854] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:34.185690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26843aad-d49e-4f05-a00f-74ffd6f68e00 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.196124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26843aad-d49e-4f05-a00f-74ffd6f68e00 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.202569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.203287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.203618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.203944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.204615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:34.205290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.207296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.221679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 920/1855] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:34.225682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2d457-cd59-4c47-ab0c-4d83affc9916 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.236370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2d457-cd59-4c47-ab0c-4d83affc9916 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.242172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.242984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.243388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.243794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.244563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.246903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.281655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 936/1856] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:34.285592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.297068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816adfbf-0343-4d4a-917f-d3e080350f64 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.370827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.371824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.372264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.372666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.373440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.376537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.412821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 921/1857] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:34.416809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.429463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c089f-8155-4365-b885-9c1a5bb06a59 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.443086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.444270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.444550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.444815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.445473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.447810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.464442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 937/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:36:34.469299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.488061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98695a0f-bbc0-46c8-87a8-f039338b1375 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.493463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1c307-a168-4838-ae6b-ced0cde78031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.494106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1c307-a168-4838-ae6b-ced0cde78031 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.494386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1c307-a168-4838-ae6b-ced0cde78031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.494820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1c307-a168-4838-ae6b-ced0cde78031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.495556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1c307-a168-4838-ae6b-ced0cde78031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.497230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1c307-a168-4838-ae6b-ced0cde78031 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.510531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 922/1859] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:34.515879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.526859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8b26a-8a10-4e2a-91c0-eb6ea6f39f63 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.533244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.534186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.534622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.535741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] PATH_INFO: `/v3/projects/9c5cd64f6b3b47048b393fee960836b0/users/e65aebd6efed4a20a31482460e66bd36/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.553554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5cd64f6b3b47048b393fee960836b0, user_id=e65aebd6efed4a20a31482460e66bd36, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.556527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.578900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 938/1860] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:34 2022] PUT /identity/v3/projects/9c5cd64f6b3b47048b393fee960836b0/users/e65aebd6efed4a20a31482460e66bd36/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:34.590385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9d3f9-78bd-4115-a51c-cb9d91707697 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.590947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9d3f9-78bd-4115-a51c-cb9d91707697 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.591352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9d3f9-78bd-4115-a51c-cb9d91707697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.644886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fef9d3f9-78bd-4115-a51c-cb9d91707697 None None] MFA Rules not processed for user `e65aebd6efed4a20a31482460e66bd36`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:34.646615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fef9d3f9-78bd-4115-a51c-cb9d91707697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:34.741488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 923/1861] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:34.746856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.865934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c61e4-d52b-43e9-ab71-968edc1e09a9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.871235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:34.872102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:34.872102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:34.872382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:34.873023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:34.875009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:34.913904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 939/1862] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/projects => generated 397 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:36:34.915335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9d3f9-78bd-4115-a51c-cb9d91707697 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.934857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9d3f9-78bd-4115-a51c-cb9d91707697 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:34.949300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:34.988305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:34.990310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:35.018504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.019589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.020003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.020498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.021311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.023715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.057923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 924/1863] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:34 2022] POST /identity/v3/users => generated 305 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:35.060358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:35.065486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:35.077884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea040f83-64e3-4a2f-baae-31143ece2dcd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.086294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.087667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.088369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.088891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.089732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.092984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.107991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 925/1864] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:35.112398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce545c54-741a-4f77-a460-e0e3d9fff117 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.113149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:35.118346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.119404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.119542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.120136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] PATH_INFO: `/v3/users/abe7307ca69849c983a08bb6cf627e99` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.122078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe7307ca69849c983a08bb6cf627e99)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.124229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.133079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b79218-dd9c-4ae4-b5f2-fe96ef7bbb95 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.138739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.139656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.140216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.140625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] PATH_INFO: `/v3/projects/e936b334f9224d50a90f713e82d37d8b/users/c5f549ec1fe947389217076132ed5a8c/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.165664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e936b334f9224d50a90f713e82d37d8b, user_id=c5f549ec1fe947389217076132ed5a8c, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.169450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.186598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 926/1865] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:35 2022] PUT /identity/v3/projects/e936b334f9224d50a90f713e82d37d8b/users/c5f549ec1fe947389217076132ed5a8c/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:35.190275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:35.208454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe7307ca69849c983a08bb6cf627e99'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:35.209649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe7307ca69849c983a08bb6cf627e99'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:35.224642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe7307ca69849c983a08bb6cf627e99'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:35.234268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe7307ca69849c983a08bb6cf627e99'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:35.235149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ca237df5-9a3e-47dc-84fd-43eb0cb09d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe7307ca69849c983a08bb6cf627e99'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:35.258988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 940/1866] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:34 2022] DELETE /identity/v3/users/abe7307ca69849c983a08bb6cf627e99 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:35.261764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.262186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.262635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.277135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a654-9c90-4890-bc94-f57be7f94735 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.288610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:35.290195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:35.379095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 941/1867] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:35.391376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.392062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.392569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.392848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.393635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.395917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.413014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 927/1868] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:35.417366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:35.419359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:35.419964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:35.422724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:35.436470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d684-79df-4317-81fb-274a467470e0 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.442889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31952d70-b823-4a07-8d67-5bfd92c11a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.443685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952d70-b823-4a07-8d67-5bfd92c11a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.443965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952d70-b823-4a07-8d67-5bfd92c11a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.444238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952d70-b823-4a07-8d67-5bfd92c11a64 admin admin] PATH_INFO: `/v3/projects/e936b334f9224d50a90f713e82d37d8b/users/c5f549ec1fe947389217076132ed5a8c/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.446238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31952d70-b823-4a07-8d67-5bfd92c11a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e936b334f9224d50a90f713e82d37d8b, user_id=c5f549ec1fe947389217076132ed5a8c, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.449024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31952d70-b823-4a07-8d67-5bfd92c11a64 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.458647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:35.474135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 942/1869] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:35 2022] PUT /identity/v3/projects/e936b334f9224d50a90f713e82d37d8b/users/c5f549ec1fe947389217076132ed5a8c/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:35.475702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c4ed-f6f0-4a06-8f6a-7f8dc5f34efb None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.476024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c4ed-f6f0-4a06-8f6a-7f8dc5f34efb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.476307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c4ed-f6f0-4a06-8f6a-7f8dc5f34efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.520095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ecd8c4ed-f6f0-4a06-8f6a-7f8dc5f34efb None None] MFA Rules not processed for user `c5f549ec1fe947389217076132ed5a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:35.521440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ecd8c4ed-f6f0-4a06-8f6a-7f8dc5f34efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:35.534778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7584-0aaf-46e5-9b5e-cf69d2b8715a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.592933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:35.660866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 943/1870] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:35 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:35.665209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.668404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.668685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.668959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.672883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c4ed-f6f0-4a06-8f6a-7f8dc5f34efb None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:35.689614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c4ed-f6f0-4a06-8f6a-7f8dc5f34efb None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:35.707110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:35.707753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:35.708028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:35.708296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:35.710185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:35.806271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.808254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.808437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:35.810679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:35.819243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 928/1871] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:36:35.829022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 944/1872] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:36:36.388923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:36.390396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:36.406649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdad5f-fcfd-4923-887b-2772b0ecc266 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:36.414377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:36.416550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:36.416550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:36.416550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] PATH_INFO: `/v3/projects/867288b1795d4cb080812d3da9d4016d` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:36.419278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=867288b1795d4cb080812d3da9d4016d)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:36.429906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:36.499865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867288b1795d4cb080812d3da9d4016d', 'request_id': 'req-8beb8823-5510-4052-bd09-d85334584974'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:36.506653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867288b1795d4cb080812d3da9d4016d', 'request_id': 'req-8beb8823-5510-4052-bd09-d85334584974'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:36.510150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:36.511944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:36.524310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867288b1795d4cb080812d3da9d4016d', 'request_id': 'req-8beb8823-5510-4052-bd09-d85334584974'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:36.546459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] The token cache is being invalidate because project 867288b1795d4cb080812d3da9d4016d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:36.546751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:36.547773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8beb8823-5510-4052-bd09-d85334584974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:36.550938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 929/1873] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:36 2022] DELETE /identity/v3/projects/867288b1795d4cb080812d3da9d4016d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:36.555601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82b8c-a4c1-40da-990f-b8f50ef5e5d8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:36.556296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82b8c-a4c1-40da-990f-b8f50ef5e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:36.556296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82b8c-a4c1-40da-990f-b8f50ef5e5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:36.570179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:36.587773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6cb82b8c-a4c1-40da-990f-b8f50ef5e5d8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:36.589016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6cb82b8c-a4c1-40da-990f-b8f50ef5e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:36.700809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263ae4-9944-4df0-9949-602d5bc941c8 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:36.701176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 930/1874] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:36.709934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d43382-b56b-4e14-a6c3-3dfee2b1a395 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:36.710304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d43382-b56b-4e14-a6c3-3dfee2b1a395 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:36.710739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d43382-b56b-4e14-a6c3-3dfee2b1a395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:36.738121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-36d43382-b56b-4e14-a6c3-3dfee2b1a395 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:36.739511 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-36d43382-b56b-4e14-a6c3-3dfee2b1a395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:36.760977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 931/1875] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:36.767900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d43382-b56b-4e14-a6c3-3dfee2b1a395 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:36.791177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d43382-b56b-4e14-a6c3-3dfee2b1a395 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:36.806894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:36.807725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:36.809546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:36.809972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:36.810736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:36.811431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:36.813241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:36.834338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:36.839173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 932/1876] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:36.840555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:36.856043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1710e-945d-4d36-b385-d4b629885b41 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:36.863851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:36.864709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:36.865204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:36.865616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:36.870368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:36.880250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:36.880891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:36.881181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:36.881431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:36.882129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:36.884345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:36.932064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 933/1877] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:36 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:36.935077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:36.964161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:36.966298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:36.981134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 945/1878] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:36 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:36:37.020314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fa6e7-d494-41d2-a886-ded898773b60 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:37.030036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:37.030821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.031862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.032148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.032982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:37.036306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:37.063309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 934/1879] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:36 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:37.068846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:37.081863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a20c49-5ef0-4e39-99f2-eb91adf84b9c service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:37.087274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:37.087968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.088306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.088668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.089439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:37.091345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:37.109764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 946/1880] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:37.111340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:37.131021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16c5f-480b-49b3-b2a9-bab369f8b8ed admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:37.135968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:37.136661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.136936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.137202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.137892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:37.139501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:37.150030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 935/1881] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:37.154749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:37.169419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78073543-9b67-4756-acdd-116c66ec93c9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:37.174565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9a4c5-0f2f-4f34-b7a8-cf0662a3b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:37.175317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a4c5-0f2f-4f34-b7a8-cf0662a3b310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.176426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a4c5-0f2f-4f34-b7a8-cf0662a3b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.176828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a4c5-0f2f-4f34-b7a8-cf0662a3b310 admin admin] PATH_INFO: `/v3/projects/3637ca127d3649eb8485693b5fee0f56/users/a8591badb7f141ae835cc901d8aadbdb/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.191010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:37.194345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:37.209510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9a4c5-0f2f-4f34-b7a8-cf0662a3b310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3637ca127d3649eb8485693b5fee0f56, user_id=a8591badb7f141ae835cc901d8aadbdb, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:37.214138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9a4c5-0f2f-4f34-b7a8-cf0662a3b310 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:37.218798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00add9e2-aadb-40dd-9f5a-5c453f87db65 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:37.226194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:37.226859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.227217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.227350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] PATH_INFO: `/v3/users/0b1897ffb368459d9dfdca560e909427` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.229699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1897ffb368459d9dfdca560e909427)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:37.232595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:37.262731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 947/1882] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:37 2022] PUT /identity/v3/projects/3637ca127d3649eb8485693b5fee0f56/users/a8591badb7f141ae835cc901d8aadbdb/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:37.264361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.264665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.264923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.305549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] MFA Rules not processed for user `a8591badb7f141ae835cc901d8aadbdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:37.306827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:37.314270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:37.329677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1897ffb368459d9dfdca560e909427'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:37.347232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1897ffb368459d9dfdca560e909427'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:37.349103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1897ffb368459d9dfdca560e909427'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:37.350774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1897ffb368459d9dfdca560e909427'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:37.417217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2f896fd9-4ff7-4451-b460-88e6e2b10f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1897ffb368459d9dfdca560e909427'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:37.437625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 948/1883] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:37.453861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:37.460117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:37.485468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 936/1884] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:37 2022] DELETE /identity/v3/users/0b1897ffb368459d9dfdca560e909427 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:37.490267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.490709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.491777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.523911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:37.525311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:37.587989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:37.602156 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189b38-d2ac-4062-9573-0018d08ff98b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:37.640203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 937/1885] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:37.656758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:37.659977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:37.703105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b56e1-9ac7-4ae0-9d27-d3af368d4799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:37.704357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b56e1-9ac7-4ae0-9d27-d3af368d4799 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.704809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b56e1-9ac7-4ae0-9d27-d3af368d4799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.705363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b56e1-9ac7-4ae0-9d27-d3af368d4799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.754522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709c121-53fd-4151-9c09-5b1412a3ab72 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:37.758891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:37.759588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:37.759917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:37.760609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:37.773028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:37.775329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:37.789243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 938/1886] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:36:37.812714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b56e1-9ac7-4ae0-9d27-d3af368d4799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:37.815141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b56e1-9ac7-4ae0-9d27-d3af368d4799 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:37.826037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 949/1887] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:38.208387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:38.210071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:38.232451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1cb11-22e9-4d8b-8db3-65ea09454d70 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:38.239621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:38.240455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.241823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.253689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] PATH_INFO: `/v3/projects/e4974e3c5c96471e9afac56c3fd3751f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.258078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4974e3c5c96471e9afac56c3fd3751f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:38.264227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:38.343421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4974e3c5c96471e9afac56c3fd3751f', 'request_id': 'req-19d4cd1d-9789-4c37-9ff9-302892902fe0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:38.344749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:38.354296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4974e3c5c96471e9afac56c3fd3751f', 'request_id': 'req-19d4cd1d-9789-4c37-9ff9-302892902fe0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:38.361948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4974e3c5c96471e9afac56c3fd3751f', 'request_id': 'req-19d4cd1d-9789-4c37-9ff9-302892902fe0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:38.376569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] The token cache is being invalidate because project e4974e3c5c96471e9afac56c3fd3751f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:38.376933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:38.377677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19d4cd1d-9789-4c37-9ff9-302892902fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:38.379686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 939/1888] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:38 2022] DELETE /identity/v3/projects/e4974e3c5c96471e9afac56c3fd3751f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:38.386234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa72b-2843-4ee1-a663-fe845ab2e6a2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.386799 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa72b-2843-4ee1-a663-fe845ab2e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.386799 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa72b-2843-4ee1-a663-fe845ab2e6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.416007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6b2aa72b-2843-4ee1-a663-fe845ab2e6a2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:38.417460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6b2aa72b-2843-4ee1-a663-fe845ab2e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:38.500201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 950/1889] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:38.508539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d365-0c18-4587-b444-9ecab63cdf45 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.509665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d365-0c18-4587-b444-9ecab63cdf45 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.510108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d365-0c18-4587-b444-9ecab63cdf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.532620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9370d365-0c18-4587-b444-9ecab63cdf45 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:38.534156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9370d365-0c18-4587-b444-9ecab63cdf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:38.547454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 940/1890] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:38.549055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa72b-2843-4ee1-a663-fe845ab2e6a2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:38.560452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa72b-2843-4ee1-a663-fe845ab2e6a2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:38.566081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:38.566942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.567359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.567796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.568594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:38.569037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:38.570947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:38.587539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 951/1891] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:38.589628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d365-0c18-4587-b444-9ecab63cdf45 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:38.602599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d365-0c18-4587-b444-9ecab63cdf45 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:38.608294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:38.608967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.609238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.609502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.610188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:38.612246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:38.649170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 941/1892] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:38 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:38.653436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:38.665200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af933e-2be3-468d-a7a4-8d08ae3417ea admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:38.724370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:38.749289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:38.749950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.750226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.750489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.751162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:38.753344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:38.780441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 952/1893] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:38 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:38.785712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:38.798268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106375f-b38b-4585-8254-c565d48a4c5e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:38.803219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:38.803841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.804252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.804648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.805468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:38.807239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:38.822111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 942/1894] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:38.824260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:38.835406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41106c-ae40-4809-8d28-3440b27d7668 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:38.841369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be8133-c774-4c5f-8767-acf0a816b7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:38.842032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be8133-c774-4c5f-8767-acf0a816b7ae admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.842307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be8133-c774-4c5f-8767-acf0a816b7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.842575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be8133-c774-4c5f-8767-acf0a816b7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.843213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be8133-c774-4c5f-8767-acf0a816b7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:38.844803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be8133-c774-4c5f-8767-acf0a816b7ae admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:38.856758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 953/1895] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:38.861464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:38.873496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690ba55-4cee-4496-aa28-fa32937c6008 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:38.880741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:38.881717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.882202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.882626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] PATH_INFO: `/v3/projects/a66bbed4087245c3810dba41b7361a1a/users/4051d787508b40e48e5dd3d731d3b415/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:38.924113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66bbed4087245c3810dba41b7361a1a, user_id=4051d787508b40e48e5dd3d731d3b415, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:38.926715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:38.957613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 943/1896] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:38 2022] PUT /identity/v3/projects/a66bbed4087245c3810dba41b7361a1a/users/4051d787508b40e48e5dd3d731d3b415/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:38.973338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:38.973670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:38.974069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:39.025568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] MFA Rules not processed for user `4051d787508b40e48e5dd3d731d3b415`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:39.027150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:39.115002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 954/1897] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:39.135229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:39.159131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:39.257767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabea6ec-923e-4fa4-b80f-db21a6cbd34a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:39.266507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde94d87-c77c-4198-adce-2c9b552a46e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:39.267312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde94d87-c77c-4198-adce-2c9b552a46e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:39.267588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde94d87-c77c-4198-adce-2c9b552a46e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:39.267913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde94d87-c77c-4198-adce-2c9b552a46e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:39.278865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde94d87-c77c-4198-adce-2c9b552a46e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:39.280781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde94d87-c77c-4198-adce-2c9b552a46e5 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:39.296811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 944/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:46.199621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:46.206485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:46.317200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d088f-9df5-4e71-9e17-09753f29b52f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:46.323472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:46.324591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:46.325061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:46.325468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] PATH_INFO: `/v3/users/e65aebd6efed4a20a31482460e66bd36` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:46.327045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65aebd6efed4a20a31482460e66bd36)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:46.329426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:46.397755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65aebd6efed4a20a31482460e66bd36'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:46.398653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65aebd6efed4a20a31482460e66bd36'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:46.406639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:46.436773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65aebd6efed4a20a31482460e66bd36'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:46.447654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65aebd6efed4a20a31482460e66bd36'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:46.449501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65aebd6efed4a20a31482460e66bd36'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:46.479116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 955/1899] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:46 2022] DELETE /identity/v3/users/e65aebd6efed4a20a31482460e66bd36 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:46.483352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:46.483854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:46.484036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:46.519288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:46.520521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:46.656783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 945/1900] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:46.678326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:46.680620 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:46.788946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ed74-43ba-4837-bb0f-14fb2567cdb0 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:46.798542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:46.799304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:46.799585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:46.799855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:46.829129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:46.830803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:46.865593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 956/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:47.498231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:47.500197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:47.522728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca45bf-0554-4827-8082-f3a6f814355d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:47.537529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:47.538406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:47.538788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:47.539163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] PATH_INFO: `/v3/projects/9c5cd64f6b3b47048b393fee960836b0` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:47.541276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5cd64f6b3b47048b393fee960836b0)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:47.544708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:47.577861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:47.636161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5cd64f6b3b47048b393fee960836b0', 'request_id': 'req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.643994 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5cd64f6b3b47048b393fee960836b0', 'request_id': 'req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.651863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5cd64f6b3b47048b393fee960836b0', 'request_id': 'req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.674424 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] The token cache is being invalidate because project 9c5cd64f6b3b47048b393fee960836b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:47.675141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.676978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.679279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 946/1902] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:47 2022] DELETE /identity/v3/projects/9c5cd64f6b3b47048b393fee960836b0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:47.683132 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:47.697808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819c888-d95a-494e-b2f2-54453095edcd service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:47.722702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:47.724704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:47.802254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:47.803648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:47.804171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:47.804702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] PATH_INFO: `/v3/users/c5f549ec1fe947389217076132ed5a8c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:47.807375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f549ec1fe947389217076132ed5a8c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:47.809812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:47.813145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3348e9-2fc2-44b2-b55a-77c604a4de0c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:47.818546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:47.819336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:47.819655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:47.819942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] PATH_INFO: `/v3/users/3863af4713c74e428db100e920bd84db` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:47.822327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3863af4713c74e428db100e920bd84db)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:47.824445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:47.911793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f549ec1fe947389217076132ed5a8c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.920318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f549ec1fe947389217076132ed5a8c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.928469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3863af4713c74e428db100e920bd84db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.938972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3863af4713c74e428db100e920bd84db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.940092 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3863af4713c74e428db100e920bd84db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.941480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3863af4713c74e428db100e920bd84db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.951828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f549ec1fe947389217076132ed5a8c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.958985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24943dd4-0ee2-4dca-83cf-d6da20ef2fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3863af4713c74e428db100e920bd84db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.967921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f549ec1fe947389217076132ed5a8c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.968681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f549ec1fe947389217076132ed5a8c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:47.972863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:47.978516 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 947/1903] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:47 2022] DELETE /identity/v3/users/3863af4713c74e428db100e920bd84db => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:47.989519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:47.990283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:47.990916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:47.995707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 957/1904] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:47 2022] DELETE /identity/v3/users/c5f549ec1fe947389217076132ed5a8c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:48.018907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:48.020142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:48.042406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:48.106362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 948/1905] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:48.126697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:48.128863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:48.211359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc93d5-68cd-4130-a7d9-badf71736ea5 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:48.216339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86972ff1-ed90-469c-8b00-98f62858fbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:48.217190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86972ff1-ed90-469c-8b00-98f62858fbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:48.217468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86972ff1-ed90-469c-8b00-98f62858fbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:48.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86972ff1-ed90-469c-8b00-98f62858fbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:48.229873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86972ff1-ed90-469c-8b00-98f62858fbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:48.231359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86972ff1-ed90-469c-8b00-98f62858fbc4 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:48.244846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 958/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:48.510236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:48.516183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:48.529575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b99e9a-88cd-4a21-8242-f78dc4ee7f99 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:48.535282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:48.536167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:48.536591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:48.537006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] PATH_INFO: `/v3/projects/e936b334f9224d50a90f713e82d37d8b` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:48.538613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e936b334f9224d50a90f713e82d37d8b)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:48.540923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:48.652870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e936b334f9224d50a90f713e82d37d8b', 'request_id': 'req-f20cb4b9-6d89-4eae-938c-2386497a4913'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:48.665916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e936b334f9224d50a90f713e82d37d8b', 'request_id': 'req-f20cb4b9-6d89-4eae-938c-2386497a4913'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:48.676446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e936b334f9224d50a90f713e82d37d8b', 'request_id': 'req-f20cb4b9-6d89-4eae-938c-2386497a4913'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:48.697130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] The token cache is being invalidate because project e936b334f9224d50a90f713e82d37d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:48.698990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:48.699948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f20cb4b9-6d89-4eae-938c-2386497a4913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:48.702464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 949/1907] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:48 2022] DELETE /identity/v3/projects/e936b334f9224d50a90f713e82d37d8b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:48.707555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33c65-1486-4d45-99e8-14fd889d72b8 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:48.707989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33c65-1486-4d45-99e8-14fd889d72b8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:48.707989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33c65-1486-4d45-99e8-14fd889d72b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:48.750419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-cae33c65-1486-4d45-99e8-14fd889d72b8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:48.751889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-cae33c65-1486-4d45-99e8-14fd889d72b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:48.860988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 959/1908] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:48.863166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713341ff-7066-46f7-b3c2-849e715ea133 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:48.864115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713341ff-7066-46f7-b3c2-849e715ea133 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:48.865454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713341ff-7066-46f7-b3c2-849e715ea133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:48.892837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-713341ff-7066-46f7-b3c2-849e715ea133 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:48.894690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-713341ff-7066-46f7-b3c2-849e715ea133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:48.906875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 950/1909] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:48.911382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33c65-1486-4d45-99e8-14fd889d72b8 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:48.921686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33c65-1486-4d45-99e8-14fd889d72b8 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:48.927857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:48.928818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:48.928937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:48.929310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:48.930675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:48.930675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:48.932393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:48.950184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 960/1910] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:48.953751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713341ff-7066-46f7-b3c2-849e715ea133 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:48.975932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713341ff-7066-46f7-b3c2-849e715ea133 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:48.993700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:48.994260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:48.994833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:48.995238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:48.995961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.002112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.019913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.021756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:49.052958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4127872-883f-498b-93ea-dafcf6fc2520 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.056951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 951/1911] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:48 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:49.059302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.176044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.177374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.178109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.179010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51ffe-1b78-4b76-afb9-c0716b140783 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.179722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] PATH_INFO: `/v3/projects/fe49e2176fe24386a5e87a080ceba685` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.182598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe49e2176fe24386a5e87a080ceba685)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.185071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.186305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.186305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.186509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.187303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.189627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.195394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.218959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 952/1912] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:49 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:49.220161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.227757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:49.233749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456e479-775e-4995-b1f1-41eea656d0ff admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.235764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:49.241522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.242542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.243231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.243778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.245360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.247742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.259692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe49e2176fe24386a5e87a080ceba685', 'request_id': 'req-3bfa0c1c-0129-492c-868a-78add79809b4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.262650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 953/1913] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:49.268077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.281873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537d84-dbf1-40d5-ac95-02c12a454672 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.284479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe49e2176fe24386a5e87a080ceba685', 'request_id': 'req-3bfa0c1c-0129-492c-868a-78add79809b4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.295721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe49e2176fe24386a5e87a080ceba685', 'request_id': 'req-3bfa0c1c-0129-492c-868a-78add79809b4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.312101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] The token cache is being invalidate because project fe49e2176fe24386a5e87a080ceba685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:49.312875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.313752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.318708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 961/1914] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:49 2022] DELETE /identity/v3/projects/fe49e2176fe24386a5e87a080ceba685 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:49.319621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.321044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:49.381494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.382207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.382644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.382923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.383783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.386193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.401847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 954/1915] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:49.406752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.409086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:49.419414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa0c1c-0129-492c-868a-78add79809b4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.425288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43c7e-d01b-40ce-b035-32e258091042 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.425765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.427389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.427681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.428034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] PATH_INFO: `/v3/users/0e78a986ff764c1f956c1d8de9c7273b` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.430280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e78a986ff764c1f956c1d8de9c7273b)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.433613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.438531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cd946-8b7a-46ad-9920-4b99e336e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.439218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd946-8b7a-46ad-9920-4b99e336e518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.439493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd946-8b7a-46ad-9920-4b99e336e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.439766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd946-8b7a-46ad-9920-4b99e336e518 admin admin] PATH_INFO: `/v3/projects/1ea68584c9494de5a7ff68917812b1a2/users/db9f48bc8a514f2daeb3dc7b50af83e2/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.463830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cd946-8b7a-46ad-9920-4b99e336e518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea68584c9494de5a7ff68917812b1a2, user_id=db9f48bc8a514f2daeb3dc7b50af83e2, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.469466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cd946-8b7a-46ad-9920-4b99e336e518 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.487069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 955/1916] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:49 2022] PUT /identity/v3/projects/1ea68584c9494de5a7ff68917812b1a2/users/db9f48bc8a514f2daeb3dc7b50af83e2/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:49.499349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.500107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.500107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.514713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e78a986ff764c1f956c1d8de9c7273b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.516282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e78a986ff764c1f956c1d8de9c7273b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.535362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] MFA Rules not processed for user `db9f48bc8a514f2daeb3dc7b50af83e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:49.536620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:49.550264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e78a986ff764c1f956c1d8de9c7273b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.565761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e78a986ff764c1f956c1d8de9c7273b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.574067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e78a986ff764c1f956c1d8de9c7273b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:49.599995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 962/1917] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:49 2022] DELETE /identity/v3/users/0e78a986ff764c1f956c1d8de9c7273b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:49.615306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 956/1918] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:49.639013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.641569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:49.690741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:49.735171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8af13-ecaa-4db5-9308-8b71707d4763 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:49.741364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df04ef-f95a-4678-8b78-abb91ba8ff22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:49.742144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df04ef-f95a-4678-8b78-abb91ba8ff22 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:49.742615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df04ef-f95a-4678-8b78-abb91ba8ff22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:49.744053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df04ef-f95a-4678-8b78-abb91ba8ff22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:49.828779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df04ef-f95a-4678-8b78-abb91ba8ff22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:49.831210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df04ef-f95a-4678-8b78-abb91ba8ff22 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:49.845711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 963/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:49.994237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:49.996772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:50.099050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:50.107080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf758951-f3d6-4756-b153-466340ac1108 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:50.193110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:50.194049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.194162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.194432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] PATH_INFO: `/v3/projects/6e6774ab11b440cc916591035095cd80` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.196202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6774ab11b440cc916591035095cd80)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:50.198590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:50.286081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6774ab11b440cc916591035095cd80', 'request_id': 'req-c5346e05-b99f-498d-bf59-eec3bf165255'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:50.295208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6774ab11b440cc916591035095cd80', 'request_id': 'req-c5346e05-b99f-498d-bf59-eec3bf165255'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:50.304753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6774ab11b440cc916591035095cd80', 'request_id': 'req-c5346e05-b99f-498d-bf59-eec3bf165255'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:50.325828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] The token cache is being invalidate because project 6e6774ab11b440cc916591035095cd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:50.326349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:50.327180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5346e05-b99f-498d-bf59-eec3bf165255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:50.329374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 957/1920] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:49 2022] DELETE /identity/v3/projects/6e6774ab11b440cc916591035095cd80 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:50.334213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad582d-5f33-4ae2-845d-cf92ce706e32 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.335336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad582d-5f33-4ae2-845d-cf92ce706e32 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.335649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad582d-5f33-4ae2-845d-cf92ce706e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.360713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-42ad582d-5f33-4ae2-845d-cf92ce706e32 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:50.362377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-42ad582d-5f33-4ae2-845d-cf92ce706e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:50.477931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 964/1921] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:50.486352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9addf-4b13-469b-9448-ff82c4017963 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.487069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9addf-4b13-469b-9448-ff82c4017963 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.487468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9addf-4b13-469b-9448-ff82c4017963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.515371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fed9addf-4b13-469b-9448-ff82c4017963 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:50.516992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fed9addf-4b13-469b-9448-ff82c4017963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:50.530366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 958/1922] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:50.531621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad582d-5f33-4ae2-845d-cf92ce706e32 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:50.544569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad582d-5f33-4ae2-845d-cf92ce706e32 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:50.551064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:50.552085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.552367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.552667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.553301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:50.553651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:50.555887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:50.575994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 965/1923] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:50.581128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9addf-4b13-469b-9448-ff82c4017963 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:50.592679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9addf-4b13-469b-9448-ff82c4017963 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:50.598840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:50.599705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.600565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.601196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.602299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:50.604598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:50.650003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 959/1924] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:50 2022] POST /identity/v3/projects => generated 359 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:50.650623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:50.664759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85222e70-626c-48ef-b007-21b33f7b100d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:50.780434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:50.782363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.782363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.782363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.783066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:50.791238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:50.846607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:50.857438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 966/1925] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:50 2022] POST /identity/v3/users => generated 280 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:50.865079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716949-237c-4d2e-acb6-682cba29fc06 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:50.874024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:50.874705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.875130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.875606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.876353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:50.878408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:50.898025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 960/1926] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:50.903272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:50.913382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:50.920068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a7de-c069-442d-a195-cbd8e33246ad admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:50.928573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b33d4-4dad-4536-8051-885f69e7a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:50.929256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b33d4-4dad-4536-8051-885f69e7a156 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.929534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b33d4-4dad-4536-8051-885f69e7a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.929833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b33d4-4dad-4536-8051-885f69e7a156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:50.930475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b33d4-4dad-4536-8051-885f69e7a156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:50.934963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b33d4-4dad-4536-8051-885f69e7a156 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:50.958020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:50.958221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 967/1927] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:50.979006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29104-b0be-48d1-afa2-6cdb3f1bf77b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:50.985202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:50.986291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:50.987278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:50.987752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] PATH_INFO: `/v3/projects/3a4b20c1df4243b596920f5ae5f959f5/users/ef18d6a685b64f3b89255b2d97d89230/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:51.014422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4b20c1df4243b596920f5ae5f959f5, user_id=ef18d6a685b64f3b89255b2d97d89230, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:51.020382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:51.050457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 961/1928] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:50 2022] PUT /identity/v3/projects/3a4b20c1df4243b596920f5ae5f959f5/users/ef18d6a685b64f3b89255b2d97d89230/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:51.060593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:51.060931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:51.061135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:51.099748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] MFA Rules not processed for user `ef18d6a685b64f3b89255b2d97d89230`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:51.101073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:51.194763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 968/1929] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:51.222642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:51.236394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:51.310617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:51.356787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed2ba-1ecd-4fbb-a4bb-f908e6672b7f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:51.362379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90e903-6f7f-41bd-8e2d-f2c98be127c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:51.362379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e903-6f7f-41bd-8e2d-f2c98be127c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:51.362696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e903-6f7f-41bd-8e2d-f2c98be127c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:51.363053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e903-6f7f-41bd-8e2d-f2c98be127c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:51.380783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90e903-6f7f-41bd-8e2d-f2c98be127c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:51.382782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90e903-6f7f-41bd-8e2d-f2c98be127c2 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:51.397388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 962/1930] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:52.495776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:52.497393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:52.642573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30756d2-a42a-46fb-ba9b-89076447e69a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:52.647306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:52.648225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:52.648653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:52.649158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] PATH_INFO: `/v3/users/4051d787508b40e48e5dd3d731d3b415` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:52.650674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4051d787508b40e48e5dd3d731d3b415)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:52.652622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:52.745461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4051d787508b40e48e5dd3d731d3b415'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:52.748339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4051d787508b40e48e5dd3d731d3b415'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:52.772422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4051d787508b40e48e5dd3d731d3b415'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:52.791465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4051d787508b40e48e5dd3d731d3b415'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:52.792470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4051d787508b40e48e5dd3d731d3b415'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:52.839396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 969/1931] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:52 2022] DELETE /identity/v3/users/4051d787508b40e48e5dd3d731d3b415 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:52.840481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:52.840932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:52.841044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:52.863991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:52.865407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.009115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 963/1932] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:53.049303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.050829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.060800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:53.153987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd34c2-525e-48c2-9486-ac816f2c7718 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:53.158312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b0ba6-d3f2-4d57-b99c-1c3557740643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:53.159146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b0ba6-d3f2-4d57-b99c-1c3557740643 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.159268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b0ba6-d3f2-4d57-b99c-1c3557740643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.159496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b0ba6-d3f2-4d57-b99c-1c3557740643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.170577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b0ba6-d3f2-4d57-b99c-1c3557740643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:53.172014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b0ba6-d3f2-4d57-b99c-1c3557740643 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:53.184554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 970/1933] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:53.717839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.720006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.746525 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecba1a-f285-4512-8cc3-48899b79cc3f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:53.759144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:53.761721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.762256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.762679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] PATH_INFO: `/v3/projects/a66bbed4087245c3810dba41b7361a1a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.764871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66bbed4087245c3810dba41b7361a1a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:53.767850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:53.864709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66bbed4087245c3810dba41b7361a1a', 'request_id': 'req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:53.874771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66bbed4087245c3810dba41b7361a1a', 'request_id': 'req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:53.885099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66bbed4087245c3810dba41b7361a1a', 'request_id': 'req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:53.911346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] The token cache is being invalidate because project a66bbed4087245c3810dba41b7361a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:53.911888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:53.914675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2b8ce57c-aa9f-4b28-8f8d-faa96fee9f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:53.920084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 964/1934] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:53 2022] DELETE /identity/v3/projects/a66bbed4087245c3810dba41b7361a1a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:36:53.925250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd110-9033-4b96-9fd8-8957df51974c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.925730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd110-9033-4b96-9fd8-8957df51974c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.925730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd110-9033-4b96-9fd8-8957df51974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.956902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7a2cd110-9033-4b96-9fd8-8957df51974c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:53.959176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7a2cd110-9033-4b96-9fd8-8957df51974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.062445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 971/1935] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:36:54.065027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31ff0-7853-4532-8f82-51ce4ee2c53c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.065441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31ff0-7853-4532-8f82-51ce4ee2c53c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.065874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31ff0-7853-4532-8f82-51ce4ee2c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.089137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2de31ff0-7853-4532-8f82-51ce4ee2c53c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:54.093289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2de31ff0-7853-4532-8f82-51ce4ee2c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.103043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 965/1936] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:54.107598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd110-9033-4b96-9fd8-8957df51974c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.118939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd110-9033-4b96-9fd8-8957df51974c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.125295 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.126078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.126460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.126947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.127706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:54.128150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.129910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.144798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 972/1937] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:54.149000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31ff0-7853-4532-8f82-51ce4ee2c53c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.161353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31ff0-7853-4532-8f82-51ce4ee2c53c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.173040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.174050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.174482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.174954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.175751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.178196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.246363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.246486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 966/1938] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:54 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:36:54.255544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2948-e798-4821-90a6-6d99f4f36a01 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.325573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.326358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.326763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.327164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.327921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.331520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.365171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 973/1939] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:54 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:54.370136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.383536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c03c40-9539-49a2-b0b9-a879d3e6ca25 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.390345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.391537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.391888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.392198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.393003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.395809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.416432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 967/1940] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:54.417398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.431877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b58d22-50f9-4a9b-b9ba-4115d4d8bc70 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.447665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f2b6-efcd-4bff-98de-8580ce47b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.448749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f2b6-efcd-4bff-98de-8580ce47b85a admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.449030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f2b6-efcd-4bff-98de-8580ce47b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.449308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f2b6-efcd-4bff-98de-8580ce47b85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.450366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f2b6-efcd-4bff-98de-8580ce47b85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.452680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f2b6-efcd-4bff-98de-8580ce47b85a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.475921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.476877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 974/1941] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:54.493387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287408e-46e2-4381-a96a-ecc6c57f4834 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.504407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.505984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.506369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.506740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] PATH_INFO: `/v3/projects/b48bb46301724a1596f3a42b328b5388/users/e08a57044bb44ae990cd5de00c13de76/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.524433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:54.532612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48bb46301724a1596f3a42b328b5388, user_id=e08a57044bb44ae990cd5de00c13de76, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.536262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.581252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 968/1942] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:54 2022] PUT /identity/v3/projects/b48bb46301724a1596f3a42b328b5388/users/e08a57044bb44ae990cd5de00c13de76/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:54.586165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416f52-7ba2-4be3-bfc8-ad296950a832 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.586643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416f52-7ba2-4be3-bfc8-ad296950a832 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.587076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416f52-7ba2-4be3-bfc8-ad296950a832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.616884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:54.636151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-34416f52-7ba2-4be3-bfc8-ad296950a832 None None] MFA Rules not processed for user `e08a57044bb44ae990cd5de00c13de76`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:54.638430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-34416f52-7ba2-4be3-bfc8-ad296950a832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.767475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 975/1943] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:54.804497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.806322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.910168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ddf3d-94aa-4900-9889-7580f929402e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.922297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc85b-605c-4801-9473-fa26814e83a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.923413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc85b-605c-4801-9473-fa26814e83a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.924038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc85b-605c-4801-9473-fa26814e83a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc85b-605c-4801-9473-fa26814e83a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.936622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bc85b-605c-4801-9473-fa26814e83a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.939817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bc85b-605c-4801-9473-fa26814e83a1 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.953883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 969/1944] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:54.970971 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34416f52-7ba2-4be3-bfc8-ad296950a832 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:55.098736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34416f52-7ba2-4be3-bfc8-ad296950a832 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:55.108147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:55.109159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:55.109588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:55.110205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] PATH_INFO: `/v3/users/e08a57044bb44ae990cd5de00c13de76` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:55.111818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08a57044bb44ae990cd5de00c13de76)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:55.114229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:55.222201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08a57044bb44ae990cd5de00c13de76'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.224519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08a57044bb44ae990cd5de00c13de76'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.249877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08a57044bb44ae990cd5de00c13de76'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.272603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08a57044bb44ae990cd5de00c13de76'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.273427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08a57044bb44ae990cd5de00c13de76'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.296022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 976/1945] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:54 2022] DELETE /identity/v3/users/e08a57044bb44ae990cd5de00c13de76 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:55.301637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:55.307656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:55.307656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:55.337218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:55.341606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:55.490309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 970/1946] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:55.521233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:55.522966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:55.587022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:55.689280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8213d7-be9e-4b63-9b4d-a8d230667ca1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:55.694138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe2d8b-e57a-4848-b822-d017ba3d2cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:55.695145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2d8b-e57a-4848-b822-d017ba3d2cbf service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:55.695613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2d8b-e57a-4848-b822-d017ba3d2cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:55.696070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2d8b-e57a-4848-b822-d017ba3d2cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:55.708957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe2d8b-e57a-4848-b822-d017ba3d2cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:55.713093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe2d8b-e57a-4848-b822-d017ba3d2cbf service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:55.731269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 977/1947] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:56.473549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:56.475258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:56.505549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb62a2-b02c-49e6-8e27-eb42539bd9c3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:56.514534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:56.515625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:56.516110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:56.516582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] PATH_INFO: `/v3/projects/b48bb46301724a1596f3a42b328b5388` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:56.518322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48bb46301724a1596f3a42b328b5388)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:56.520363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:56.594837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48bb46301724a1596f3a42b328b5388', 'request_id': 'req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.602573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48bb46301724a1596f3a42b328b5388', 'request_id': 'req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.611747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48bb46301724a1596f3a42b328b5388', 'request_id': 'req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.642749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] The token cache is being invalidate because project b48bb46301724a1596f3a42b328b5388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:56.643343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.644232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c5a3c7d6-8e7f-407b-89b0-c4f92ebd545c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.653529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 971/1948] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:56 2022] DELETE /identity/v3/projects/b48bb46301724a1596f3a42b328b5388 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:56.654343 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d57d-8f53-4e1b-9d8b-c6a099262ed2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:56.654829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d57d-8f53-4e1b-9d8b-c6a099262ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:56.654910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d57d-8f53-4e1b-9d8b-c6a099262ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:56.709908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4990d57d-8f53-4e1b-9d8b-c6a099262ed2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:56.711676 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4990d57d-8f53-4e1b-9d8b-c6a099262ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:56.867160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d281-6564-4e51-8561-a787b1888802 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:56.867737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d281-6564-4e51-8561-a787b1888802 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:56.867737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665d281-6564-4e51-8561-a787b1888802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:56.871432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 978/1949] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:56.907677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0665d281-6564-4e51-8561-a787b1888802 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:56.908947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0665d281-6564-4e51-8561-a787b1888802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:56.929981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 972/1950] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:56.934344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d57d-8f53-4e1b-9d8b-c6a099262ed2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:56.949956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d57d-8f53-4e1b-9d8b-c6a099262ed2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:56.959231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:56.959894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:56.960302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:56.960804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:56.961120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:56.961473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:56.965325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:56.984123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665d281-6564-4e51-8561-a787b1888802 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:56.990358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 979/1951] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:56.996239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665d281-6564-4e51-8561-a787b1888802 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:57.002952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:57.003787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:57.004151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:57.004422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:57.005235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:57.007440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:57.020622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:57.048217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 973/1952] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:56 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:36:57.052847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:57.067176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19947a-e9d4-4f1d-8d50-e9b81a24e194 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:57.167986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254987-412c-44de-b144-706431972504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:57.169335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254987-412c-44de-b144-706431972504 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:57.169663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254987-412c-44de-b144-706431972504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:57.170041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254987-412c-44de-b144-706431972504 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:57.170798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56254987-412c-44de-b144-706431972504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:57.176642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56254987-412c-44de-b144-706431972504 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:57.234278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 980/1953] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:57 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:57.240119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:57.285327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad068-be76-42be-98b8-5de60125ec87 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:57.303365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:57.304013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:57.305948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:57.306687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:57.307142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:57.308950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:57.343467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254987-412c-44de-b144-706431972504 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:57.345718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 974/1954] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:57.356107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254987-412c-44de-b144-706431972504 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:57.368565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0c597-e424-46ae-a73c-96ecc2a290ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:57.369489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c597-e424-46ae-a73c-96ecc2a290ff admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:57.369727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c597-e424-46ae-a73c-96ecc2a290ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:57.370100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c597-e424-46ae-a73c-96ecc2a290ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:57.370753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c597-e424-46ae-a73c-96ecc2a290ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:57.375765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c597-e424-46ae-a73c-96ecc2a290ff admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:57.404785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 981/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:57.409230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:57.420946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba1b3-6faa-41b0-93b8-7e79e4840385 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:57.451949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:57.452665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:57.452937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:57.453493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] PATH_INFO: `/v3/projects/fc81ef0fb28a4e39a4bc1874bdf9686c/users/9a5784c46a9640c29c5eff9001e31398/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:57.481724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc81ef0fb28a4e39a4bc1874bdf9686c, user_id=9a5784c46a9640c29c5eff9001e31398, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:57.489308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:57.528406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 975/1956] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:57 2022] PUT /identity/v3/projects/fc81ef0fb28a4e39a4bc1874bdf9686c/users/9a5784c46a9640c29c5eff9001e31398/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:57.529028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7087-ef2c-4c2e-9ebf-abe29d3d2cb9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:57.529560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7087-ef2c-4c2e-9ebf-abe29d3d2cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:57.529888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7087-ef2c-4c2e-9ebf-abe29d3d2cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:57.586798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5ccf7087-ef2c-4c2e-9ebf-abe29d3d2cb9 None None] MFA Rules not processed for user `9a5784c46a9640c29c5eff9001e31398`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:57.588199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5ccf7087-ef2c-4c2e-9ebf-abe29d3d2cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:57.636878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:57.779267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 982/1957] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:57.873065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:57.875047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:58.023483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e426434-684f-46c5-a715-c574b9c8ec79 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:58.030279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bb14b-db11-4e87-aa24-eb53be8539f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:58.032661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bb14b-db11-4e87-aa24-eb53be8539f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:58.033123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bb14b-db11-4e87-aa24-eb53be8539f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:58.033702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bb14b-db11-4e87-aa24-eb53be8539f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:58.069226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bb14b-db11-4e87-aa24-eb53be8539f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:58.073601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bb14b-db11-4e87-aa24-eb53be8539f6 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:58.098574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 976/1958] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:00.104194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf7087-ef2c-4c2e-9ebf-abe29d3d2cb9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:00.173923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf7087-ef2c-4c2e-9ebf-abe29d3d2cb9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:00.180555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:00.186643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:00.187174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:00.187835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] PATH_INFO: `/v3/users/9a5784c46a9640c29c5eff9001e31398` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:00.190019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5784c46a9640c29c5eff9001e31398)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:00.193302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:00.264477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5784c46a9640c29c5eff9001e31398'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:00.266405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5784c46a9640c29c5eff9001e31398'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:00.282026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5784c46a9640c29c5eff9001e31398'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:00.291141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5784c46a9640c29c5eff9001e31398'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:00.292407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5784c46a9640c29c5eff9001e31398'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:00.321573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 983/1959] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:00 2022] DELETE /identity/v3/users/9a5784c46a9640c29c5eff9001e31398 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:00.323267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:00.323762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:00.323841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:00.350282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:00.363105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:00.493522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 977/1960] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:00.524745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:00.531304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:00.622546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:00.658148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a8413-8025-4390-890c-fb82321a5bed admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:00.666001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:00.666789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:00.667981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:00.669535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:00.687013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:00.688923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:00.708692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 984/1961] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:01.768615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:01.772085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:01.795075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03327-2ce4-4eb2-9502-26bf297ce9d3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:01.818589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:01.819330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:01.819463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:01.820035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] PATH_INFO: `/v3/projects/fc81ef0fb28a4e39a4bc1874bdf9686c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:01.822419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc81ef0fb28a4e39a4bc1874bdf9686c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:01.824745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:01.996576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc81ef0fb28a4e39a4bc1874bdf9686c', 'request_id': 'req-88bfd4f6-6607-4d06-ae33-8477d461576e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:02.008922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:02.021662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc81ef0fb28a4e39a4bc1874bdf9686c', 'request_id': 'req-88bfd4f6-6607-4d06-ae33-8477d461576e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:02.047486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc81ef0fb28a4e39a4bc1874bdf9686c', 'request_id': 'req-88bfd4f6-6607-4d06-ae33-8477d461576e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:02.105971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] The token cache is being invalidate because project fc81ef0fb28a4e39a4bc1874bdf9686c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:37:02.107242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:02.108443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-88bfd4f6-6607-4d06-ae33-8477d461576e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:02.120613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 978/1962] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:37:01 2022] DELETE /identity/v3/projects/fc81ef0fb28a4e39a4bc1874bdf9686c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:10.698984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=9 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:12.091102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=5,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:31.268436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:31.270644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:31.293271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f6a1c-8213-42bd-80b0-eb4fb9124cb2 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:31.385044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:31.385929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:31.386364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:31.386950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] PATH_INFO: `/v3/users/a8591badb7f141ae835cc901d8aadbdb` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:31.388585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8591badb7f141ae835cc901d8aadbdb)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:31.391477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:31.496652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8591badb7f141ae835cc901d8aadbdb'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:31.497325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8591badb7f141ae835cc901d8aadbdb'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:31.529342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8591badb7f141ae835cc901d8aadbdb'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:31.541705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8591badb7f141ae835cc901d8aadbdb'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:31.542742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8591badb7f141ae835cc901d8aadbdb'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:31.585071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 985/1963] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:31 2022] DELETE /identity/v3/users/a8591badb7f141ae835cc901d8aadbdb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:31.590390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:31.590975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:31.590975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:31.638992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:31.640259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:31.811610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 979/1964] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:31.827493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:31.830099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:32.034652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605762a-a4ba-480b-b7cc-c9293dc65917 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:32.043047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d505c-a624-4858-aae4-82548816a003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:32.044008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d505c-a624-4858-aae4-82548816a003 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:32.044506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d505c-a624-4858-aae4-82548816a003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:32.045847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d505c-a624-4858-aae4-82548816a003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:32.075337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d505c-a624-4858-aae4-82548816a003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:32.077118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d505c-a624-4858-aae4-82548816a003 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:32.102366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 986/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:33.249982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:33.251586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:33.283394 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beb6d2-5a19-498b-ae26-6ab86f0f5775 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:33.303659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:33.304417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:33.304790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:33.305275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] PATH_INFO: `/v3/projects/3637ca127d3649eb8485693b5fee0f56` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:33.307744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3637ca127d3649eb8485693b5fee0f56)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:33.312393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:33.452541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3637ca127d3649eb8485693b5fee0f56', 'request_id': 'req-fde125fc-a798-469a-81ed-1150a75ed3be'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:33.469540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3637ca127d3649eb8485693b5fee0f56', 'request_id': 'req-fde125fc-a798-469a-81ed-1150a75ed3be'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:33.482793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3637ca127d3649eb8485693b5fee0f56', 'request_id': 'req-fde125fc-a798-469a-81ed-1150a75ed3be'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:33.516878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] The token cache is being invalidate because project 3637ca127d3649eb8485693b5fee0f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:37:33.517295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:33.518661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fde125fc-a798-469a-81ed-1150a75ed3be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:33.525395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 980/1966] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:37:33 2022] DELETE /identity/v3/projects/3637ca127d3649eb8485693b5fee0f56 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:33.530181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c592c-7ef7-44b9-8784-83a693b665d9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:33.531074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c592c-7ef7-44b9-8784-83a693b665d9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:33.531074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c592c-7ef7-44b9-8784-83a693b665d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:33.565104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-681c592c-7ef7-44b9-8784-83a693b665d9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:33.566949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-681c592c-7ef7-44b9-8784-83a693b665d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:33.593759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:33.673708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 987/1967] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:33.676279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688a220-26f9-4142-a5ed-bfefe96ffe53 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:33.678609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688a220-26f9-4142-a5ed-bfefe96ffe53 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:33.679189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688a220-26f9-4142-a5ed-bfefe96ffe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:33.702063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9688a220-26f9-4142-a5ed-bfefe96ffe53 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:33.703928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9688a220-26f9-4142-a5ed-bfefe96ffe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:33.715373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 981/1968] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:33.720053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c592c-7ef7-44b9-8784-83a693b665d9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:33.733864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c592c-7ef7-44b9-8784-83a693b665d9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:33.740864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:33.741593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:33.741953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:33.742283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:33.743387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:37:33.743695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:33.745578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:33.769418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 988/1969] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:37:33.770026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688a220-26f9-4142-a5ed-bfefe96ffe53 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:33.784423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688a220-26f9-4142-a5ed-bfefe96ffe53 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:33.795577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:33.796392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:33.796734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:33.797577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:33.798487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:33.801199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:33.843411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 982/1970] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:37:33 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:37:33.847688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:33.859316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbf8bd-81d3-4cd2-b49d-e4cf84d04974 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:33.983279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:33.983923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:33.984200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:33.985371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:33.985371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:33.989639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:34.040276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 989/1971] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:37:33 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:34.041538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:34.053458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf3a3-2cdf-494d-8d56-7ed79cc0c910 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:34.060945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:34.061854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:34.062331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:34.062777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:34.063555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:34.065419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:34.077988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 983/1972] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:37:34.081084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:34.101267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cad29-286e-45e2-ac94-4682661aa29f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:34.108398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970604e1-8f91-4cf8-8f2f-d8d9d0a664cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:34.109540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970604e1-8f91-4cf8-8f2f-d8d9d0a664cc admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:34.109540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970604e1-8f91-4cf8-8f2f-d8d9d0a664cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:34.109540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970604e1-8f91-4cf8-8f2f-d8d9d0a664cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:34.110135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970604e1-8f91-4cf8-8f2f-d8d9d0a664cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:34.112983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970604e1-8f91-4cf8-8f2f-d8d9d0a664cc admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:34.143551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 990/1973] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:34.144809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:34.159516 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac781-b58c-448d-85eb-aa5f3c8c332a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:34.178187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:34.178844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:34.179114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:34.179368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] PATH_INFO: `/v3/projects/ab7e9058fb2c4bd7aebf920c58baceae/users/69108ec8b68d49ba9bf437189d982e6f/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:34.206437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7e9058fb2c4bd7aebf920c58baceae, user_id=69108ec8b68d49ba9bf437189d982e6f, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:34.209037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:34.241964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 984/1974] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:37:34 2022] PUT /identity/v3/projects/ab7e9058fb2c4bd7aebf920c58baceae/users/69108ec8b68d49ba9bf437189d982e6f/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:34.252474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d41e-d4f0-47bc-aea2-6c7e23222b9e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:34.253207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d41e-d4f0-47bc-aea2-6c7e23222b9e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:34.253207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d41e-d4f0-47bc-aea2-6c7e23222b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:34.306514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-3922d41e-d4f0-47bc-aea2-6c7e23222b9e None None] MFA Rules not processed for user `69108ec8b68d49ba9bf437189d982e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:34.308496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3922d41e-d4f0-47bc-aea2-6c7e23222b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:34.424043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 991/1975] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:34.440210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:34.442661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:34.487448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:34.548509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107488c-0a52-44a0-8336-a2bd75f1aa2a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:34.552942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02036-cb38-4e93-b284-52cd2596ab8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:34.553865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02036-cb38-4e93-b284-52cd2596ab8b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:34.554355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02036-cb38-4e93-b284-52cd2596ab8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:34.554763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02036-cb38-4e93-b284-52cd2596ab8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:34.566177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02036-cb38-4e93-b284-52cd2596ab8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:34.568024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02036-cb38-4e93-b284-52cd2596ab8b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:34.586706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 985/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:35.381585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922d41e-d4f0-47bc-aea2-6c7e23222b9e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:35.411921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:35.478029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922d41e-d4f0-47bc-aea2-6c7e23222b9e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:35.484646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:35.485372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:35.485649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:35.485942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] PATH_INFO: `/v3/users/69108ec8b68d49ba9bf437189d982e6f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:35.488129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=69108ec8b68d49ba9bf437189d982e6f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:35.490719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:35.562735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69108ec8b68d49ba9bf437189d982e6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:35.564733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69108ec8b68d49ba9bf437189d982e6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:35.587399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69108ec8b68d49ba9bf437189d982e6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:35.598516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69108ec8b68d49ba9bf437189d982e6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:35.599652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69108ec8b68d49ba9bf437189d982e6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:35.629293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 992/1977] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:35 2022] DELETE /identity/v3/users/69108ec8b68d49ba9bf437189d982e6f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:35.631068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:35.631462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:35.631865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:35.681318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:35.683387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:35.762592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 986/1978] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:37:35.776827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:35.777666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:35.937013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10184-b84e-4275-89ea-50716d99e63f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:35.965770 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140c2ce-1abe-4d73-bfbb-1bb7f315e973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:35.966468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c2ce-1abe-4d73-bfbb-1bb7f315e973 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:35.966741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c2ce-1abe-4d73-bfbb-1bb7f315e973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:35.967013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c2ce-1abe-4d73-bfbb-1bb7f315e973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:35.990827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140c2ce-1abe-4d73-bfbb-1bb7f315e973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:35.993149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140c2ce-1abe-4d73-bfbb-1bb7f315e973 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:36.021074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 993/1979] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:37:37.000007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:37.001452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:37.032906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c96b-13bb-4560-8002-7e14c9a26ca9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:37.043052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:37.043729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.044007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.044293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] PATH_INFO: `/v3/projects/ab7e9058fb2c4bd7aebf920c58baceae` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.057260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7e9058fb2c4bd7aebf920c58baceae)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:37.059399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:37.149492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7e9058fb2c4bd7aebf920c58baceae', 'request_id': 'req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:37.157597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7e9058fb2c4bd7aebf920c58baceae', 'request_id': 'req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:37.168436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7e9058fb2c4bd7aebf920c58baceae', 'request_id': 'req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:37.189962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] The token cache is being invalidate because project ab7e9058fb2c4bd7aebf920c58baceae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:37:37.190846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:37.191883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a9f0f286-5cc4-4f34-97d4-26fd3be7be12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:37.197942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 987/1980] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:37:36 2022] DELETE /identity/v3/projects/ab7e9058fb2c4bd7aebf920c58baceae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:37.199453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754180c-6bf6-4e3d-9ea4-516f9044c65c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.199911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754180c-6bf6-4e3d-9ea4-516f9044c65c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.200023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754180c-6bf6-4e3d-9ea4-516f9044c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.237542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6754180c-6bf6-4e3d-9ea4-516f9044c65c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:37.239636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6754180c-6bf6-4e3d-9ea4-516f9044c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:37.315773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:37.368160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fed51-d989-4fb3-be56-6be3d63ccc23 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.368490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fed51-d989-4fb3-be56-6be3d63ccc23 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.369158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fed51-d989-4fb3-be56-6be3d63ccc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.372317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 994/1981] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:37.399992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8c8fed51-d989-4fb3-be56-6be3d63ccc23 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:37.401280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8c8fed51-d989-4fb3-be56-6be3d63ccc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:37.411228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 988/1982] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:37.415735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754180c-6bf6-4e3d-9ea4-516f9044c65c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:37.430030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754180c-6bf6-4e3d-9ea4-516f9044c65c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:37.440946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:37.441591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.441900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.442334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.443124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:37:37.443440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:37.445126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:37.465457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fed51-d989-4fb3-be56-6be3d63ccc23 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:37.476096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fed51-d989-4fb3-be56-6be3d63ccc23 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:37.476983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 995/1983] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:37:37.482517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:37.483146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.483421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.483699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.484483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:37.486907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:37.532521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 989/1984] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:37:37 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:37.536989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:37.550323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d87764-5c36-4d33-b0cb-5048150df641 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:37.672559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:37.673381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.673522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.673754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.674417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:37.676370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:37.720860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 996/1985] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:37:37 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:37.725007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:37.785983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54b91f-0eab-443e-8282-0751cc02fb7a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:37.796185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:37.797321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.797999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.798410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.799193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:37.802177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:37.817895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 990/1986] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:37.821776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:37.836996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69b30-5599-4ea8-a7ad-e78bc7dd68f2 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:37.844271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0719e5-cfd8-4d53-adab-bbea5cd672e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:37.845137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0719e5-cfd8-4d53-adab-bbea5cd672e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.845424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0719e5-cfd8-4d53-adab-bbea5cd672e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.845691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0719e5-cfd8-4d53-adab-bbea5cd672e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.846383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0719e5-cfd8-4d53-adab-bbea5cd672e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:37.847991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0719e5-cfd8-4d53-adab-bbea5cd672e8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:37.886259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 997/1987] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:37.887569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:37.900504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded814-8004-4446-8380-4d7d9c8d7831 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:37.909528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:37.911105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.911552 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.911962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] PATH_INFO: `/v3/projects/ed528629f14a4fbf8843e0f5bdfc096e/users/d2ae3c695cd349a49446a2742e354b92/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:37.917745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:37.952481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed528629f14a4fbf8843e0f5bdfc096e, user_id=d2ae3c695cd349a49446a2742e354b92, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:37.955889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:37.979557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 991/1988] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:37:37 2022] PUT /identity/v3/projects/ed528629f14a4fbf8843e0f5bdfc096e/users/d2ae3c695cd349a49446a2742e354b92/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:37:37.989692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a3686-3f9a-4317-a8a9-25ab762dbf1b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:37.989992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a3686-3f9a-4317-a8a9-25ab762dbf1b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:37.990265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a3686-3f9a-4317-a8a9-25ab762dbf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:38.027954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-494a3686-3f9a-4317-a8a9-25ab762dbf1b None None] MFA Rules not processed for user `d2ae3c695cd349a49446a2742e354b92`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:38.029431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-494a3686-3f9a-4317-a8a9-25ab762dbf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:38.120527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 998/1989] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:38.380936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:38.386632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:38.565373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33505-d0ff-4e1c-a09b-f3a9b0d63422 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:38.569495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28594ab8-2681-4df5-8286-7ed4b9fb1d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:38.570363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594ab8-2681-4df5-8286-7ed4b9fb1d97 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:38.570819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594ab8-2681-4df5-8286-7ed4b9fb1d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:38.571250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28594ab8-2681-4df5-8286-7ed4b9fb1d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:38.583433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28594ab8-2681-4df5-8286-7ed4b9fb1d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:38.586390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28594ab8-2681-4df5-8286-7ed4b9fb1d97 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:38.601677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 992/1990] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:38.826209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a3686-3f9a-4317-a8a9-25ab762dbf1b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:38.921823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:38.963139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a3686-3f9a-4317-a8a9-25ab762dbf1b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:38.986073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:38.987152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:38.987625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:38.988091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] PATH_INFO: `/v3/users/d2ae3c695cd349a49446a2742e354b92` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:38.989488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ae3c695cd349a49446a2742e354b92)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:38.991793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:39.113516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ae3c695cd349a49446a2742e354b92'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:39.121829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ae3c695cd349a49446a2742e354b92'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:39.160985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ae3c695cd349a49446a2742e354b92'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:39.179299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ae3c695cd349a49446a2742e354b92'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:39.180268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ae3c695cd349a49446a2742e354b92'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:39.205413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 999/1991] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:38 2022] DELETE /identity/v3/users/d2ae3c695cd349a49446a2742e354b92 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:39.210091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:39.210091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:39.210610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:39.253442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:39.256625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:39.452930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 993/1992] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:37:39.488525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:39.490110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:39.624514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1230e-b322-447e-9376-4474474efb1a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:39.634131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:39.634794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:39.635072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:39.635336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:39.675349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:39.682379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:39.728411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1000/1993] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:41.464458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:41.468339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:41.488028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c0ea6-3245-4bab-bc3d-c07db09b2afd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:41.504729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:41.505643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:41.506149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:41.506389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] PATH_INFO: `/v3/projects/ed528629f14a4fbf8843e0f5bdfc096e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:41.507632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed528629f14a4fbf8843e0f5bdfc096e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:41.509715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:41.625430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed528629f14a4fbf8843e0f5bdfc096e', 'request_id': 'req-2d01d959-7587-4e27-95a3-422d68989f6b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:41.640676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed528629f14a4fbf8843e0f5bdfc096e', 'request_id': 'req-2d01d959-7587-4e27-95a3-422d68989f6b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:41.648029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed528629f14a4fbf8843e0f5bdfc096e', 'request_id': 'req-2d01d959-7587-4e27-95a3-422d68989f6b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:41.672081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] The token cache is being invalidate because project ed528629f14a4fbf8843e0f5bdfc096e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:37:41.672369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:41.673205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2d01d959-7587-4e27-95a3-422d68989f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:41.674939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 994/1994] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:37:41 2022] DELETE /identity/v3/projects/ed528629f14a4fbf8843e0f5bdfc096e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:46.411148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:46.413291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:46.441035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cfc11-cec1-4469-884f-ae4c13d5561a service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:46.587979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:46.607965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:46.608912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:46.609197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:46.609469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] PATH_INFO: `/v3/users/ef18d6a685b64f3b89255b2d97d89230` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:46.610738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef18d6a685b64f3b89255b2d97d89230)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:46.615104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:46.728553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef18d6a685b64f3b89255b2d97d89230'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:46.728553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef18d6a685b64f3b89255b2d97d89230'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:46.741679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef18d6a685b64f3b89255b2d97d89230'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:46.749662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef18d6a685b64f3b89255b2d97d89230'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:46.750549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef18d6a685b64f3b89255b2d97d89230'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:46.769836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1001/1995] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:46 2022] DELETE /identity/v3/users/ef18d6a685b64f3b89255b2d97d89230 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:46.772120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:46.772587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:46.772678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:46.798237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:46.799508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:46.807287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:46.906892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 995/1996] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:46.940109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:46.942042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:47.041746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5cb2-115b-4011-8b73-4a908e035e3d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:47.046324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6323ed6-fe4a-4f43-8893-02c9b7b1e979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:47.046960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323ed6-fe4a-4f43-8893-02c9b7b1e979 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:47.047237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323ed6-fe4a-4f43-8893-02c9b7b1e979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:47.047493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323ed6-fe4a-4f43-8893-02c9b7b1e979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:47.058521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6323ed6-fe4a-4f43-8893-02c9b7b1e979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:47.059973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6323ed6-fe4a-4f43-8893-02c9b7b1e979 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:47.082487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1002/1997] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:47.523877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:47.525736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:47.545690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1ea4a-f53a-4a0a-ad7f-25e4848e0155 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:47.558737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:47.560199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:47.560498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:47.560750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] PATH_INFO: `/v3/projects/3a4b20c1df4243b596920f5ae5f959f5` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:47.561974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4b20c1df4243b596920f5ae5f959f5)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:47.564493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:47.647001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4b20c1df4243b596920f5ae5f959f5', 'request_id': 'req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:47.655390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4b20c1df4243b596920f5ae5f959f5', 'request_id': 'req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:47.664338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4b20c1df4243b596920f5ae5f959f5', 'request_id': 'req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:47.690085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] The token cache is being invalidate because project 3a4b20c1df4243b596920f5ae5f959f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:37:47.691206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:47.692543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd46c365-9e4a-49fa-b3a2-ec46105c20c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:47.702748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 996/1998] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:37:47 2022] DELETE /identity/v3/projects/3a4b20c1df4243b596920f5ae5f959f5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:47.706536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a271-a183-4e76-80dd-7a3f93cad42d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:47.707572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a271-a183-4e76-80dd-7a3f93cad42d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:47.708479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a271-a183-4e76-80dd-7a3f93cad42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:47.750910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b672a271-a183-4e76-80dd-7a3f93cad42d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:47.752161 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b672a271-a183-4e76-80dd-7a3f93cad42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:47.834212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1003/1999] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:47.843695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e526-5ad1-4c66-9cf8-98017d56406a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:47.844303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e526-5ad1-4c66-9cf8-98017d56406a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:47.844303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e526-5ad1-4c66-9cf8-98017d56406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:47.873996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8b52e526-5ad1-4c66-9cf8-98017d56406a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:47.875738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8b52e526-5ad1-4c66-9cf8-98017d56406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:47.890665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 997/2000] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:47.895140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672a271-a183-4e76-80dd-7a3f93cad42d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:47.911367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672a271-a183-4e76-80dd-7a3f93cad42d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:47.916931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:47.917584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:47.917967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:47.918219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:47.918892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:37:47.919195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:47.920882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:47.940648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1004/2001] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:37:47.945130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e526-5ad1-4c66-9cf8-98017d56406a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:47.956732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e526-5ad1-4c66-9cf8-98017d56406a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:47.962184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:47.962810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:47.963084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:47.963352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:47.963996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:47.965985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:47.996779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 998/2002] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:37:47 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:48.001414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:48.013588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8489efa-5c33-40ea-9533-302402007903 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:48.017761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:48.086089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:48.087052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.087326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.087594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.088235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:48.090265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:48.114340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1005/2003] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:37:48 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:48.119236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:48.130707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb3c20-e73e-456f-8e88-245500280850 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:48.136873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:48.137522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.137813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.138117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.138921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:48.140560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:48.151586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 999/2004] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:48.156271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:48.168278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d888-d930-4a38-8628-ae129cf80c99 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:48.174574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c2386-f382-4969-90be-73e4ec847bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:48.175201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c2386-f382-4969-90be-73e4ec847bda admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.175482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c2386-f382-4969-90be-73e4ec847bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.175747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c2386-f382-4969-90be-73e4ec847bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.176418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c2386-f382-4969-90be-73e4ec847bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:48.178117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c2386-f382-4969-90be-73e4ec847bda admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:48.190708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1006/2005] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:48.195230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:48.206742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06ecd-ab26-45ec-bfa8-5b552a44eb42 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:48.221927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:48.222728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.223066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.223577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] PATH_INFO: `/v3/projects/fec0698358f94f3995feec9bf128b26e/users/a0e00fe531d140ef9059285160149344/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.241150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec0698358f94f3995feec9bf128b26e, user_id=a0e00fe531d140ef9059285160149344, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:48.243906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:48.269244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1000/2006] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:37:48 2022] PUT /identity/v3/projects/fec0698358f94f3995feec9bf128b26e/users/a0e00fe531d140ef9059285160149344/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:48.281238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd4b3-cc7c-47d0-a1f0-c8303a7cf61b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.282364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd4b3-cc7c-47d0-a1f0-c8303a7cf61b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.282364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd4b3-cc7c-47d0-a1f0-c8303a7cf61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.332931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5a7fd4b3-cc7c-47d0-a1f0-c8303a7cf61b None None] MFA Rules not processed for user `a0e00fe531d140ef9059285160149344`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:48.334933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5a7fd4b3-cc7c-47d0-a1f0-c8303a7cf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:48.435374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1007/2007] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:48.446857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:48.448483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:48.485408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:48.527029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcb50f-b97b-43d8-8535-b72421c6e621 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:48.533701 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b982c-98ba-4452-acde-d1b1e96dc696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:48.534529 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b982c-98ba-4452-acde-d1b1e96dc696 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.534810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b982c-98ba-4452-acde-d1b1e96dc696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.535137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b982c-98ba-4452-acde-d1b1e96dc696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.550642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b982c-98ba-4452-acde-d1b1e96dc696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:48.552370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b982c-98ba-4452-acde-d1b1e96dc696 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:48.567469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1001/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:48.586107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd4b3-cc7c-47d0-a1f0-c8303a7cf61b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:48.670583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd4b3-cc7c-47d0-a1f0-c8303a7cf61b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:48.677011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:48.677739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.678049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.678301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] PATH_INFO: `/v3/users/a0e00fe531d140ef9059285160149344` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.679621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e00fe531d140ef9059285160149344)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:48.682086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:48.702208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:48.748353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e00fe531d140ef9059285160149344'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:48.749018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e00fe531d140ef9059285160149344'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:48.763386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e00fe531d140ef9059285160149344'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:48.772200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e00fe531d140ef9059285160149344'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:48.773199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e00fe531d140ef9059285160149344'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:48.792309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1008/2009] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:48 2022] DELETE /identity/v3/users/a0e00fe531d140ef9059285160149344 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:48.796732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.797006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.797271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:48.818687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:48.820974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:48.901122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1002/2010] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:37:48.912263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:48.914074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:48.988442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a1c0-5b09-423d-acdd-4c4c0d598aef admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:48.993559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd47e5-109c-43fd-b92c-7abcbd19a807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:48.994223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47e5-109c-43fd-b92c-7abcbd19a807 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:48.994519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47e5-109c-43fd-b92c-7abcbd19a807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:48.994784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47e5-109c-43fd-b92c-7abcbd19a807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:49.009600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd47e5-109c-43fd-b92c-7abcbd19a807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:49.011201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd47e5-109c-43fd-b92c-7abcbd19a807 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:49.022217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1009/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:50.357574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:50.359737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:50.372186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f74f89-fab3-4dec-a1dc-d83d62f39250 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:50.377009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:50.377657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:50.377976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:50.378243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] PATH_INFO: `/v3/projects/fec0698358f94f3995feec9bf128b26e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:50.379356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec0698358f94f3995feec9bf128b26e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:50.381269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:50.435617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec0698358f94f3995feec9bf128b26e', 'request_id': 'req-070d3e2a-e868-4fb8-85ac-1ca041176071'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:50.442288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec0698358f94f3995feec9bf128b26e', 'request_id': 'req-070d3e2a-e868-4fb8-85ac-1ca041176071'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:50.452364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec0698358f94f3995feec9bf128b26e', 'request_id': 'req-070d3e2a-e868-4fb8-85ac-1ca041176071'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:50.476625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] The token cache is being invalidate because project fec0698358f94f3995feec9bf128b26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:37:50.476800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:50.490312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-070d3e2a-e868-4fb8-85ac-1ca041176071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:50.505454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1003/2012] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:37:50 2022] DELETE /identity/v3/projects/fec0698358f94f3995feec9bf128b26e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:50.507283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc294-b93a-46b2-b9da-c412375f134f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:50.507943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc294-b93a-46b2-b9da-c412375f134f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:50.507943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc294-b93a-46b2-b9da-c412375f134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:50.535689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6c6cc294-b93a-46b2-b9da-c412375f134f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:50.536921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6c6cc294-b93a-46b2-b9da-c412375f134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:50.643922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1010/2013] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:50.646776 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf393-358a-4cf5-83f7-182eff3096ad None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:50.647429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf393-358a-4cf5-83f7-182eff3096ad None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:50.647878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf393-358a-4cf5-83f7-182eff3096ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:50.682376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-47fbf393-358a-4cf5-83f7-182eff3096ad None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:50.683619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-47fbf393-358a-4cf5-83f7-182eff3096ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:50.703337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1004/2014] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:37:50.707663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc294-b93a-46b2-b9da-c412375f134f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:50.720844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc294-b93a-46b2-b9da-c412375f134f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:50.726754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:50.727680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:50.728023 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:50.728366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:50.729894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:37:50.730272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:50.731964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:50.765861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1011/2015] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:37:50.770154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf393-358a-4cf5-83f7-182eff3096ad None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:50.782724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf393-358a-4cf5-83f7-182eff3096ad None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:50.792448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:50.792725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:50.793078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:50.801397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:50.802472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:50.804652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:50.847630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1005/2016] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:37:50 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:50.851777 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:50.868430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d99450-b823-4c52-ad64-03c798391cdd admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:50.918492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:50.977823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:50.978628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:50.979110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:50.979443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:50.980205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:50.982375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:51.009622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1012/2017] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:37:50 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:51.010924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:51.023272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde0bef-796c-4d21-b5ad-92036c47a4fd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:51.034185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:51.034805 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:51.034996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:51.035853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:51.036538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:51.039838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:51.061371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1006/2018] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:51.064989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:51.094636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fa522-0daf-4ba9-b1ac-3ad96f6078bd admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:51.105773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150008-95b9-47d9-bf42-9182cdc4e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:51.106807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150008-95b9-47d9-bf42-9182cdc4e7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:51.107180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150008-95b9-47d9-bf42-9182cdc4e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:51.107543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150008-95b9-47d9-bf42-9182cdc4e7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:51.108292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40150008-95b9-47d9-bf42-9182cdc4e7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:51.111382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40150008-95b9-47d9-bf42-9182cdc4e7a1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:51.138795 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1013/2019] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:37:51.140196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:51.157445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592510cc-6db2-4e79-9328-429c42d9b6f6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:51.172020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:51.172714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:51.172987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:51.173423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] PATH_INFO: `/v3/projects/40daf01efed840f6b798f6ce5cb171f9/users/d6da1567b25f4d0a849e1377500d322b/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:51.200343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:51.204955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40daf01efed840f6b798f6ce5cb171f9, user_id=d6da1567b25f4d0a849e1377500d322b, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:51.207465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:51.229171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1007/2020] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:37:51 2022] PUT /identity/v3/projects/40daf01efed840f6b798f6ce5cb171f9/users/d6da1567b25f4d0a849e1377500d322b/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:51.238835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:51.239261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:51.239530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:51.275030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] MFA Rules not processed for user `d6da1567b25f4d0a849e1377500d322b`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:51.276470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:51.362353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1014/2021] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:51.411338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:51.413243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:51.498793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53168d-3738-4a0c-9414-df599b15649d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:51.503985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:51.504617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:51.504889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:51.505152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:51.517574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:51.519028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:51.533286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1008/2022] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:53.541275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:53.542936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:53.639561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19557-68af-4f89-95bb-4bb435b4f007 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:53.644285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:53.644939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:53.645215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:53.645484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] PATH_INFO: `/v3/users/7c242f07981e43c28e280d945631de66` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:53.646746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c242f07981e43c28e280d945631de66)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:53.648794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:53.713475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:53.729939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c242f07981e43c28e280d945631de66'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:53.731012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c242f07981e43c28e280d945631de66'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:53.754244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c242f07981e43c28e280d945631de66'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:53.765986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c242f07981e43c28e280d945631de66'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:53.767006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dbb38d00-9711-4fd9-8e53-6cac69791e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c242f07981e43c28e280d945631de66'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:53.789227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1015/2023] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:53 2022] DELETE /identity/v3/users/7c242f07981e43c28e280d945631de66 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:55.025889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:55.043556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac36c5-33d2-4984-8568-ce575c0a84be service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:55.332156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:55.332826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:55.333105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:55.333544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] PATH_INFO: `/v3/projects/cd8aa66f7b6d447db64002a46bef393a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:55.334744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8aa66f7b6d447db64002a46bef393a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:55.337214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:55.460157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8aa66f7b6d447db64002a46bef393a', 'request_id': 'req-8487e064-bd1f-459d-ba52-c6231498e2b9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:55.498470 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8aa66f7b6d447db64002a46bef393a', 'request_id': 'req-8487e064-bd1f-459d-ba52-c6231498e2b9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:55.510834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8aa66f7b6d447db64002a46bef393a', 'request_id': 'req-8487e064-bd1f-459d-ba52-c6231498e2b9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:55.539540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] The token cache is being invalidate because project cd8aa66f7b6d447db64002a46bef393a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:37:55.549842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:55.551289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8487e064-bd1f-459d-ba52-c6231498e2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:37:55.558449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1009/2024] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:37:55 2022] DELETE /identity/v3/projects/cd8aa66f7b6d447db64002a46bef393a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:55.559640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea32c2-76b2-4d5e-825e-a0e0ad043101 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:55.560509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea32c2-76b2-4d5e-825e-a0e0ad043101 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:55.560941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea32c2-76b2-4d5e-825e-a0e0ad043101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:55.629439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f8ea32c2-76b2-4d5e-825e-a0e0ad043101 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:55.631059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f8ea32c2-76b2-4d5e-825e-a0e0ad043101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:55.733522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1016/2025] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:55.744712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f2b4-82e4-446a-a6fa-b3becfb6ca65 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:55.745027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f2b4-82e4-446a-a6fa-b3becfb6ca65 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:55.745308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f2b4-82e4-446a-a6fa-b3becfb6ca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:55.775842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1a25f2b4-82e4-446a-a6fa-b3becfb6ca65 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:55.777164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a25f2b4-82e4-446a-a6fa-b3becfb6ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:55.788173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1010/2026] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:55.794065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea32c2-76b2-4d5e-825e-a0e0ad043101 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:55.814012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea32c2-76b2-4d5e-825e-a0e0ad043101 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:55.818935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:55.819563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:55.819891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:55.820163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:55.820822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:37:55.821117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:55.822752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:55.848178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1017/2027] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:37:55.852647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25f2b4-82e4-446a-a6fa-b3becfb6ca65 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:55.863526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25f2b4-82e4-446a-a6fa-b3becfb6ca65 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:55.870009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:55.870630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:55.871097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:55.871370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:55.872671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:55.874835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:55.905489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:55.969752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:55.977180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1011/2028] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:37:55 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:55.988736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0205d7-c0e6-47b2-9106-9965fb1db7d9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:56.128858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:56.129816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:56.130243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:56.130635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:56.131480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:56.134381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:56.197156 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1018/2029] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:37:55 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:56.198458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:56.212601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d423b35-a53c-4e01-a1b1-b49b36439f0a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:56.223596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:56.225287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:56.226692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:56.227344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:56.228288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:56.231906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:56.258266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1012/2030] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:56.262358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:56.283208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108b75a-aaba-4aa2-a429-fd3938cc5d62 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:56.294140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd594-4cfd-4456-8496-c1e514401cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:56.295473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd594-4cfd-4456-8496-c1e514401cee admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:56.295976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd594-4cfd-4456-8496-c1e514401cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:56.296457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd594-4cfd-4456-8496-c1e514401cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:56.297400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd594-4cfd-4456-8496-c1e514401cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:56.300642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd594-4cfd-4456-8496-c1e514401cee admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:56.316747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1019/2031] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:56.320980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:56.335901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccbbd6-045b-42c9-a784-9a51690cf0cf admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:56.341944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:56.342951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:56.343422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:56.344513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] PATH_INFO: `/v3/projects/8db8caec049c47f8958248adb04a598c/users/5c0880682eec400f87240068e0c271ab/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:56.367143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db8caec049c47f8958248adb04a598c, user_id=5c0880682eec400f87240068e0c271ab, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:56.372640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:56.393986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1013/2032] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:37:56 2022] PUT /identity/v3/projects/8db8caec049c47f8958248adb04a598c/users/5c0880682eec400f87240068e0c271ab/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:56.406321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8351-2076-46fb-aa32-7e7abc4e50d9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:56.406970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8351-2076-46fb-aa32-7e7abc4e50d9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:56.407569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8351-2076-46fb-aa32-7e7abc4e50d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:56.450072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-53cf8351-2076-46fb-aa32-7e7abc4e50d9 None None] MFA Rules not processed for user `5c0880682eec400f87240068e0c271ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:56.452072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-53cf8351-2076-46fb-aa32-7e7abc4e50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:56.458570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:56.564276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1020/2033] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:56.568715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:56.696174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b15c-f30f-419e-bad6-97edc8e1a175 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:56.701656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:56.702582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:56.703026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:56.703471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:56.704536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:56.708442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:56.765599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1014/2034] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:37:56 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:37:56.771689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf8351-2076-46fb-aa32-7e7abc4e50d9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:56.786859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf8351-2076-46fb-aa32-7e7abc4e50d9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:56.902781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:56.904273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:56.905868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:56.906662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:56.909543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:56.913253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:56.964061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:56.965751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1021/2035] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:37:56 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:37:56.988390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d056967-c3ae-44a7-9035-be0a0b2ad645 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:57.003890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:57.004532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:57.005391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:57.005676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:57.006446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:57.010028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:57.037160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1015/2036] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:57.042565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:57.053617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8eee-2f53-4554-9b4e-80acee31bde1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:57.065929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:57.067259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:57.067951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:57.068498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] PATH_INFO: `/v3/projects/8e2326686c1d4027b21ba0a74c98790c/users/7d23957ed8914ce8aaaf1904103df939/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:57.106902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2326686c1d4027b21ba0a74c98790c, user_id=7d23957ed8914ce8aaaf1904103df939, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:57.114130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:57.172514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1022/2037] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:37:57 2022] PUT /identity/v3/projects/8e2326686c1d4027b21ba0a74c98790c/users/7d23957ed8914ce8aaaf1904103df939/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:57.174375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:57.195131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74dc18-9317-4293-91f2-027e92d79f28 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:57.395118 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf7b22-753c-4ba6-a67b-389c6c14cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:57.399289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf7b22-753c-4ba6-a67b-389c6c14cb28 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:57.399842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf7b22-753c-4ba6-a67b-389c6c14cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:57.400566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf7b22-753c-4ba6-a67b-389c6c14cb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:57.402339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf7b22-753c-4ba6-a67b-389c6c14cb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:57.407573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf7b22-753c-4ba6-a67b-389c6c14cb28 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:57.455888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1016/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:37:57.459984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:57.482026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261f48-ac93-4692-8574-c791b5dce09d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:57.488983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:57.490039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:57.490492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:57.490945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] PATH_INFO: `/v3/projects/8e2326686c1d4027b21ba0a74c98790c/users/7d23957ed8914ce8aaaf1904103df939/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:57.493954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2326686c1d4027b21ba0a74c98790c, user_id=7d23957ed8914ce8aaaf1904103df939, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:57.497847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:57.518547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1023/2039] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:37:57 2022] PUT /identity/v3/projects/8e2326686c1d4027b21ba0a74c98790c/users/7d23957ed8914ce8aaaf1904103df939/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:37:57.532891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:57.533728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:57.534304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:57.581393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] MFA Rules not processed for user `7d23957ed8914ce8aaaf1904103df939`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:37:57.584147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:57.643003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:57.835100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1017/2040] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:37:57.876261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:57.878139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:37:58.030677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c98a6-f103-420c-8f40-4a107512ab1a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:37:58.035137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:37:58.035472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:37:58.035842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:37:58.036368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:37:58.050234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:37:58.052610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:37:58.080486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1024/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:37:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:37:59.995811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:37:59.997993 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:00.136708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe854-9e70-4b9b-97a7-27daa5090004 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:00.142537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:00.143504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:00.143707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:00.144025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] PATH_INFO: `/v3/users/662238e056e640468faeb943a6f7fa0a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:00.145243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662238e056e640468faeb943a6f7fa0a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:00.147430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:00.215615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662238e056e640468faeb943a6f7fa0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:00.225462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662238e056e640468faeb943a6f7fa0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:00.226902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662238e056e640468faeb943a6f7fa0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:00.227659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662238e056e640468faeb943a6f7fa0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:00.246072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-12f34ded-5066-48a7-81bd-42393c2d6662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662238e056e640468faeb943a6f7fa0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:00.268573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1018/2042] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:37:59 2022] DELETE /identity/v3/users/662238e056e640468faeb943a6f7fa0a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:00.937725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:00.946493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:00.957182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f0659-9955-4bad-b0cb-677f737e7637 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:01.085702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:01.086091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:01.086363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:01.086630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] PATH_INFO: `/v3/projects/8637199252f442dc855428cbb9b0b1b8` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:01.087776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=8637199252f442dc855428cbb9b0b1b8)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:01.094724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:01.271266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8637199252f442dc855428cbb9b0b1b8', 'request_id': 'req-8311177e-e400-4ba0-93ce-62862ebf3dde'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:01.302565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8637199252f442dc855428cbb9b0b1b8', 'request_id': 'req-8311177e-e400-4ba0-93ce-62862ebf3dde'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:01.320801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8637199252f442dc855428cbb9b0b1b8', 'request_id': 'req-8311177e-e400-4ba0-93ce-62862ebf3dde'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:01.353183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] The token cache is being invalidate because project 8637199252f442dc855428cbb9b0b1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:01.353484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:01.355558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8311177e-e400-4ba0-93ce-62862ebf3dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:01.361272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1025/2043] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:00 2022] DELETE /identity/v3/projects/8637199252f442dc855428cbb9b0b1b8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:01.363582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b167a-b03f-4f1e-815c-e4f2207fe7b5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:01.364079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b167a-b03f-4f1e-815c-e4f2207fe7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:01.364277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b167a-b03f-4f1e-815c-e4f2207fe7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:01.413500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a57b167a-b03f-4f1e-815c-e4f2207fe7b5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:01.415343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a57b167a-b03f-4f1e-815c-e4f2207fe7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:01.491580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:01.573997 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1019/2044] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:01.575940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057593be-c0e2-4842-ab24-e9b3691c41cd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:01.577126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057593be-c0e2-4842-ab24-e9b3691c41cd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:01.577496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057593be-c0e2-4842-ab24-e9b3691c41cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:01.648562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-057593be-c0e2-4842-ab24-e9b3691c41cd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:01.649711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-057593be-c0e2-4842-ab24-e9b3691c41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:01.677339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1026/2045] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:01.681666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b167a-b03f-4f1e-815c-e4f2207fe7b5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:01.693405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b167a-b03f-4f1e-815c-e4f2207fe7b5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:01.700353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:01.700992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:01.701265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:01.701528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:01.702217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:01.702517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:01.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:01.724956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057593be-c0e2-4842-ab24-e9b3691c41cd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:01.732240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1020/2046] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:01.736974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057593be-c0e2-4842-ab24-e9b3691c41cd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:01.742890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:01.743520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:01.743789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:01.744851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:01.745521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:01.748489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:01.798941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1027/2047] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:01 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:01.804722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:01.816712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c532f1-0ca2-4a87-a27b-064082a1ac3e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:01.950352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:01.951087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:01.951408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:01.951701 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:01.953007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:01.955227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:01.988894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1021/2048] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:01 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:01.994076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:02.021194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7ae02-4e55-48c1-9941-77a58c6d550f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:02.041499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:02.042396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.043729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.044180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.045027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:02.051882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:02.080466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1028/2049] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:02.085576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:02.100445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c98d0b-0ef0-49c6-b1c0-730b0c3d5dfd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:02.127905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0ef1d-9343-4c08-9757-e684c5ee7e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:02.128560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0ef1d-9343-4c08-9757-e684c5ee7e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.128842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0ef1d-9343-4c08-9757-e684c5ee7e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.129112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0ef1d-9343-4c08-9757-e684c5ee7e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.129976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0ef1d-9343-4c08-9757-e684c5ee7e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:02.131627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0ef1d-9343-4c08-9757-e684c5ee7e2e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:02.161237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1022/2050] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:02.167427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:02.188324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dcee7-8521-43f9-9d67-f1d55063a374 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:02.198287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:02.199071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.199840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.200118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] PATH_INFO: `/v3/projects/0ca40f134c814bffb72209b9d4f5d929/users/b16bfada7308427c97bc48800e32b14d/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.239057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca40f134c814bffb72209b9d4f5d929, user_id=b16bfada7308427c97bc48800e32b14d, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:02.245292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:02.288993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1029/2051] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:02 2022] PUT /identity/v3/projects/0ca40f134c814bffb72209b9d4f5d929/users/b16bfada7308427c97bc48800e32b14d/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:02.299897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261fa52-1159-48de-8488-4224a7ef01ef None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.300172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261fa52-1159-48de-8488-4224a7ef01ef None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.300432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261fa52-1159-48de-8488-4224a7ef01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.347059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e261fa52-1159-48de-8488-4224a7ef01ef None None] MFA Rules not processed for user `b16bfada7308427c97bc48800e32b14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:02.352205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e261fa52-1159-48de-8488-4224a7ef01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:02.537184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:02.540087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:02.574574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1023/2052] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:02.576684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261fa52-1159-48de-8488-4224a7ef01ef None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:02.590974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:02.646319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757534-310a-47e6-842a-9e0464967a9b admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:02.651491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:02.653966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:02.655318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.655898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.655898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] PATH_INFO: `/v3/users/5c0880682eec400f87240068e0c271ab` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.661534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0880682eec400f87240068e0c271ab)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:02.664840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:02.701294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261fa52-1159-48de-8488-4224a7ef01ef None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:02.707097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:02.707968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.708385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.708799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.709638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:02.711866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:02.740800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0880682eec400f87240068e0c271ab'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:02.742031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0880682eec400f87240068e0c271ab'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:02.757244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1024/2053] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:02 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:02.757475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0880682eec400f87240068e0c271ab'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:02.761531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:02.772051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0880682eec400f87240068e0c271ab'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:02.772891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-302467d7-fc2c-4fd0-a59e-7c54b5156fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0880682eec400f87240068e0c271ab'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:02.794502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1030/2054] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:02 2022] DELETE /identity/v3/users/5c0880682eec400f87240068e0c271ab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:02.800899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.801529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.802011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.830850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:02.832699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:02.856693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378678-9247-44c3-9955-2fc9efae6ab1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:02.918251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1031/2055] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:02.938207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:02.940502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:02.954643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:02.955117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:02.955427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:02.955701 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:02.956899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:02.959785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:02.996218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1025/2056] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:02 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:03.005323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:03.008981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:03.029455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b3764-513e-4a5c-b088-fcd519196a5e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:03.031005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:03.037871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0ca8-120b-4151-92b8-a0420c552f0d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:03.039722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:03.040934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:03.041451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:03.042142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:03.043255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:03.045544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:03.046607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:03.047743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:03.049343 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:03.062875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:03.075818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:03.077870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:03.080017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1026/2057] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:03.083989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:03.090615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1032/2058] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:03.105125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdd3ed-31be-4aa4-aff8-c9caf73b6565 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:03.112651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:03.113596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:03.114051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:03.114493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] PATH_INFO: `/v3/projects/98ca3fb5adfa42ac98fbeb01b63be49c/users/54ac8adad45948e4980a1b116dda45e4/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:03.137957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ca3fb5adfa42ac98fbeb01b63be49c, user_id=54ac8adad45948e4980a1b116dda45e4, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:03.141635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:03.171062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1027/2059] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:03 2022] PUT /identity/v3/projects/98ca3fb5adfa42ac98fbeb01b63be49c/users/54ac8adad45948e4980a1b116dda45e4/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:03.175938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:03.196139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bbeb6-7948-4a8b-be16-995fe97f8c0a service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:03.334909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1c761-78cc-437b-8a09-dc973a852f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:03.336414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1c761-78cc-437b-8a09-dc973a852f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:03.336787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1c761-78cc-437b-8a09-dc973a852f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:03.337176 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1c761-78cc-437b-8a09-dc973a852f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:03.338070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1c761-78cc-437b-8a09-dc973a852f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:03.345868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1c761-78cc-437b-8a09-dc973a852f05 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:03.380496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1033/2060] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:03.385977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:03.405927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c533a2f-c25b-4347-9a00-0619a17cf40f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:03.415560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:03.416597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:03.417037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:03.417695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] PATH_INFO: `/v3/projects/98ca3fb5adfa42ac98fbeb01b63be49c/users/54ac8adad45948e4980a1b116dda45e4/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:03.420691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ca3fb5adfa42ac98fbeb01b63be49c, user_id=54ac8adad45948e4980a1b116dda45e4, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:03.423747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:03.440861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1028/2061] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:03 2022] PUT /identity/v3/projects/98ca3fb5adfa42ac98fbeb01b63be49c/users/54ac8adad45948e4980a1b116dda45e4/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:03.456321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:03.457835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:03.458616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:03.512666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] MFA Rules not processed for user `54ac8adad45948e4980a1b116dda45e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:03.514390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:03.693937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1034/2062] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:03.779213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:03.793886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:03.803954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:03.924073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7b37-e9cf-4d62-a07f-9566a56417be admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:03.929707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:03.929968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:03.930348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:03.930675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:03.957329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:03.962075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:03.987458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1029/2063] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:04.202633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:04.204348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:04.363847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862065-460d-48d9-8cc3-88f95278429b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:04.370715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:04.371375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:04.371665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:04.371912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] PATH_INFO: `/v3/projects/8db8caec049c47f8958248adb04a598c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:04.373770 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db8caec049c47f8958248adb04a598c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:04.376664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:04.412615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:04.471021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db8caec049c47f8958248adb04a598c', 'request_id': 'req-eab70726-2d0d-4ed7-99e7-c625f39e823f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.481807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db8caec049c47f8958248adb04a598c', 'request_id': 'req-eab70726-2d0d-4ed7-99e7-c625f39e823f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.496111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db8caec049c47f8958248adb04a598c', 'request_id': 'req-eab70726-2d0d-4ed7-99e7-c625f39e823f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.515228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] The token cache is being invalidate because project 8db8caec049c47f8958248adb04a598c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:04.516456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.517056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.524100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1035/2064] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:04 2022] DELETE /identity/v3/projects/8db8caec049c47f8958248adb04a598c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:04.524921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:04.547927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229057-bc68-486e-8c24-1343fac4c18d service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:04.674450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:04.675426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:04.675987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:04.676420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] PATH_INFO: `/v3/users/7d23957ed8914ce8aaaf1904103df939` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:04.677907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d23957ed8914ce8aaaf1904103df939)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:04.680744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:04.809498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d23957ed8914ce8aaaf1904103df939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.842473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d23957ed8914ce8aaaf1904103df939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.843881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d23957ed8914ce8aaaf1904103df939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.846322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d23957ed8914ce8aaaf1904103df939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.875772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e2981c1b-ec8b-4369-bb78-19cfdaf04ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d23957ed8914ce8aaaf1904103df939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:04.903574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1030/2065] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:04 2022] DELETE /identity/v3/users/7d23957ed8914ce8aaaf1904103df939 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:06.049225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:06.050738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:06.065488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab70726-2d0d-4ed7-99e7-c625f39e823f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:06.138414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:06.139435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:06.139920 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:06.140370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] PATH_INFO: `/v3/projects/8e2326686c1d4027b21ba0a74c98790c` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:06.142723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2326686c1d4027b21ba0a74c98790c)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:06.146708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:06.266869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2326686c1d4027b21ba0a74c98790c', 'request_id': 'req-66ab97d9-e5c6-4398-b319-5b3490926d4c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:06.290765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2326686c1d4027b21ba0a74c98790c', 'request_id': 'req-66ab97d9-e5c6-4398-b319-5b3490926d4c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:06.313138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2326686c1d4027b21ba0a74c98790c', 'request_id': 'req-66ab97d9-e5c6-4398-b319-5b3490926d4c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:06.334790 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] The token cache is being invalidate because project 8e2326686c1d4027b21ba0a74c98790c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:06.335765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:06.337630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-66ab97d9-e5c6-4398-b319-5b3490926d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:06.343704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1036/2066] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:06 2022] DELETE /identity/v3/projects/8e2326686c1d4027b21ba0a74c98790c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:06.348407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf3a4-4f11-4da9-85a0-0baf941ce00e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:06.349225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf3a4-4f11-4da9-85a0-0baf941ce00e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:06.349642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf3a4-4f11-4da9-85a0-0baf941ce00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:06.375719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9b6bf3a4-4f11-4da9-85a0-0baf941ce00e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:06.378645 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9b6bf3a4-4f11-4da9-85a0-0baf941ce00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:06.415431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:06.482603 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1031/2067] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:06.485201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930452-eaa1-454e-9c59-db2b193120ef None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:06.485741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930452-eaa1-454e-9c59-db2b193120ef None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:06.486821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930452-eaa1-454e-9c59-db2b193120ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:06.519031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-40930452-eaa1-454e-9c59-db2b193120ef None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:06.527413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-40930452-eaa1-454e-9c59-db2b193120ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:06.544903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1037/2068] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:06.546417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf3a4-4f11-4da9-85a0-0baf941ce00e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:06.560810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf3a4-4f11-4da9-85a0-0baf941ce00e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:06.575281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:06.575922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:06.576198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:06.576613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:06.577745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:06.578231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:06.579914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:06.596153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1032/2069] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:06.600903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930452-eaa1-454e-9c59-db2b193120ef None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:06.612468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930452-eaa1-454e-9c59-db2b193120ef None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:06.628387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:06.629320 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:06.629821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:06.630094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:06.630841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:06.633120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:06.733836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1038/2070] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:06 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:06.738924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:06.752782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbb949-cc93-411e-94fc-e73728dddbe0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:06.854667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:06.863982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:06.864533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:06.865037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:06.866044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:06.868888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:06.928409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1033/2071] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:06 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:06.930858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:06.943942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:06.948991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1585347-feed-4379-b8c7-3648970e473e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:06.962741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:06.963658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:06.964031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:06.964836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:06.966837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:06.971600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:07.002821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1039/2072] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:07.007063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:07.020420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba239-966d-4c9f-8571-4f1aaf3ced08 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:07.026635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873cdf-4951-43a3-a8b0-7046db4f31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:07.027316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873cdf-4951-43a3-a8b0-7046db4f31d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:07.027596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873cdf-4951-43a3-a8b0-7046db4f31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:07.027863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873cdf-4951-43a3-a8b0-7046db4f31d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:07.028602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873cdf-4951-43a3-a8b0-7046db4f31d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:07.030752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873cdf-4951-43a3-a8b0-7046db4f31d2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:07.044686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1034/2073] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:07.048716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:07.060560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3186-79b3-47fc-846c-657747e0b1c9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:07.066880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:07.067704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:07.068143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:07.068496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] PATH_INFO: `/v3/projects/99e2dc8eb7a146c3be4206fd2b3ccf7c/users/daa52c2dae4c406caded5ba32fabf708/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:07.088722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e2dc8eb7a146c3be4206fd2b3ccf7c, user_id=daa52c2dae4c406caded5ba32fabf708, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:07.091318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:07.122852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1040/2074] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:07 2022] PUT /identity/v3/projects/99e2dc8eb7a146c3be4206fd2b3ccf7c/users/daa52c2dae4c406caded5ba32fabf708/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:07.133281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:07.133563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:07.133880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:07.172072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] MFA Rules not processed for user `daa52c2dae4c406caded5ba32fabf708`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:07.173440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:07.250779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:07.257158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:07.270808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1035/2075] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:07.289936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:07.291599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:07.333189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:07.380617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f290b-52dd-43e0-b4f6-4a29d0e3d198 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:07.386777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c2272-6faa-46a0-9fcf-a5152e692054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:07.387636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c2272-6faa-46a0-9fcf-a5152e692054 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:07.388125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c2272-6faa-46a0-9fcf-a5152e692054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:07.388461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c2272-6faa-46a0-9fcf-a5152e692054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:07.400851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c2272-6faa-46a0-9fcf-a5152e692054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:07.403013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c2272-6faa-46a0-9fcf-a5152e692054 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:07.403362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf0282-40b5-4298-bc31-892ffbf06500 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:07.416164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1036/2076] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:07.418882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:07.419560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:07.419840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:07.420108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] PATH_INFO: `/v3/users/b16bfada7308427c97bc48800e32b14d` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:07.421979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16bfada7308427c97bc48800e32b14d)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:07.424774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:07.518574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16bfada7308427c97bc48800e32b14d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:07.520516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16bfada7308427c97bc48800e32b14d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:07.552864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16bfada7308427c97bc48800e32b14d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:07.568515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16bfada7308427c97bc48800e32b14d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:07.570468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16bfada7308427c97bc48800e32b14d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:07.598534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1041/2077] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:07 2022] DELETE /identity/v3/users/b16bfada7308427c97bc48800e32b14d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:07.603473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:07.604549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:07.604810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:07.655952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:07.658303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:07.784633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1037/2078] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:07.855124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:07.857344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:07.929010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:07.936679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab1ea8-71ab-45e8-9491-7ecf5f49a23b admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:07.948140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:07.949153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:07.949615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:07.951132 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:07.968706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:07.970953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:07.984637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1042/2079] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:08.514913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:08.517373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:08.548307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c3e11-a6ba-4972-b334-8d4e39b764a5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:08.568801 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:08.569581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:08.569927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:08.570304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] PATH_INFO: `/v3/projects/0ca40f134c814bffb72209b9d4f5d929` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:08.576330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca40f134c814bffb72209b9d4f5d929)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:08.578543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:08.682044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca40f134c814bffb72209b9d4f5d929', 'request_id': 'req-e8622997-622e-424c-992b-5d1f9477c128'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.689829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca40f134c814bffb72209b9d4f5d929', 'request_id': 'req-e8622997-622e-424c-992b-5d1f9477c128'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.698616 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca40f134c814bffb72209b9d4f5d929', 'request_id': 'req-e8622997-622e-424c-992b-5d1f9477c128'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.724079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] The token cache is being invalidate because project 0ca40f134c814bffb72209b9d4f5d929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:08.724676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.726113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.728601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1038/2080] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:08 2022] DELETE /identity/v3/projects/0ca40f134c814bffb72209b9d4f5d929 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:08.732393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:08.743570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97d08f-25a8-485a-a88f-cba4b82ecc0c service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:08.828689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:08.829673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:08.830158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:08.830736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] PATH_INFO: `/v3/users/54ac8adad45948e4980a1b116dda45e4` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:08.832321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ac8adad45948e4980a1b116dda45e4)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:08.835851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:08.928779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ac8adad45948e4980a1b116dda45e4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.930933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ac8adad45948e4980a1b116dda45e4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.970746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ac8adad45948e4980a1b116dda45e4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.991173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ac8adad45948e4980a1b116dda45e4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:08.992058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-031e9c0b-2316-45c7-9a84-dd1ff9e59e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ac8adad45948e4980a1b116dda45e4'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:09.022865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1043/2081] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:08 2022] DELETE /identity/v3/users/54ac8adad45948e4980a1b116dda45e4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:10.274449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.276699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:10.303038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8622997-622e-424c-992b-5d1f9477c128 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:10.405282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:10.448905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:10.449868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.450333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.450820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] PATH_INFO: `/v3/projects/98ca3fb5adfa42ac98fbeb01b63be49c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.452193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ca3fb5adfa42ac98fbeb01b63be49c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:10.454395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:10.568694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ca3fb5adfa42ac98fbeb01b63be49c', 'request_id': 'req-24a928fd-e426-42a0-b623-402a619275a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:10.580307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ca3fb5adfa42ac98fbeb01b63be49c', 'request_id': 'req-24a928fd-e426-42a0-b623-402a619275a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:10.596573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ca3fb5adfa42ac98fbeb01b63be49c', 'request_id': 'req-24a928fd-e426-42a0-b623-402a619275a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:10.619983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] The token cache is being invalidate because project 98ca3fb5adfa42ac98fbeb01b63be49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:10.620618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:10.622700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-24a928fd-e426-42a0-b623-402a619275a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:10.626190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1039/2082] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:10 2022] DELETE /identity/v3/projects/98ca3fb5adfa42ac98fbeb01b63be49c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:10.632751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030de01-1a25-4424-a3b7-d26ad649ad6a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.633557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030de01-1a25-4424-a3b7-d26ad649ad6a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.634034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030de01-1a25-4424-a3b7-d26ad649ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.664749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6030de01-1a25-4424-a3b7-d26ad649ad6a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:10.666242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6030de01-1a25-4424-a3b7-d26ad649ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:10.755887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1044/2083] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:10.764749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4665791-d4d5-45f4-92c4-3db1a536052c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.765013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4665791-d4d5-45f4-92c4-3db1a536052c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.765520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4665791-d4d5-45f4-92c4-3db1a536052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.814919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c4665791-d4d5-45f4-92c4-3db1a536052c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:10.816314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c4665791-d4d5-45f4-92c4-3db1a536052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:10.827702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1040/2084] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:10.835528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030de01-1a25-4424-a3b7-d26ad649ad6a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.849034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030de01-1a25-4424-a3b7-d26ad649ad6a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:10.855119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:10.855725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.856258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.856627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.857386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:10.857785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:10.859830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:10.867945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:10.880953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4665791-d4d5-45f4-92c4-3db1a536052c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.886133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1045/2085] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:10.892891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4665791-d4d5-45f4-92c4-3db1a536052c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:10.898661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:10.899346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:10.899837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:10.900171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:10.900871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:10.903019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:10.944514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1041/2086] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:10.949188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:10.973766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f513-c5cb-467e-b1a3-5917d0cebfd1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.079470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.092730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.093273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.093775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.094841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.097360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.126460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1046/2087] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:10 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:11.131504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.147267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa1da-26ec-495e-b696-9b7fd88ba511 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.156116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.156452 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.156684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.156949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.157589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.171087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.183544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1042/2088] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:11.187579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.201446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab36d5c-d9ac-420b-994d-92054dfdf804 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.207175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222aa4b-2972-4d35-8241-568518778fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.208013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222aa4b-2972-4d35-8241-568518778fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.208653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222aa4b-2972-4d35-8241-568518778fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.209115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222aa4b-2972-4d35-8241-568518778fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.210016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222aa4b-2972-4d35-8241-568518778fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.212299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222aa4b-2972-4d35-8241-568518778fd4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.234908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1047/2089] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:11.239897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.251676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834846b-8f12-4bc1-b246-86bf04118f8a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.263438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.264178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.264465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.264724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] PATH_INFO: `/v3/projects/2bbacaba483541a7b2fe514bd4979b7f/users/d77c141b7d6442f2ba8a13c68aaa0783/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.287337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbacaba483541a7b2fe514bd4979b7f, user_id=d77c141b7d6442f2ba8a13c68aaa0783, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.293604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.318845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1043/2090] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:11 2022] PUT /identity/v3/projects/2bbacaba483541a7b2fe514bd4979b7f/users/d77c141b7d6442f2ba8a13c68aaa0783/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:11.331010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cb9c2-ae70-4da3-ac26-15d1e5fda993 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.331328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cb9c2-ae70-4da3-ac26-15d1e5fda993 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.331654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cb9c2-ae70-4da3-ac26-15d1e5fda993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.399645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1f0cb9c2-ae70-4da3-ac26-15d1e5fda993 None None] MFA Rules not processed for user `d77c141b7d6442f2ba8a13c68aaa0783`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:11.402817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1f0cb9c2-ae70-4da3-ac26-15d1e5fda993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:11.540583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1048/2091] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:11.545306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.671013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598cad0-14af-4636-a35b-25512cd99e9d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.676231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.676965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.677360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.677739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.678780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.681726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.714988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:11.728822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1044/2092] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:11 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:11.729059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cb9c2-ae70-4da3-ac26-15d1e5fda993 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.740769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cb9c2-ae70-4da3-ac26-15d1e5fda993 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.818469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.819348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.819622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.819894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.820751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.823166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.856707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:11.881204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1049/2093] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:11 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:11.882901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.902694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4ed8-aac6-4ebd-9f26-63105db8649a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.910407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.911800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.912251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.912660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.913653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:11.917026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:11.932161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1045/2094] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:11.936493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:11.958608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854ec30-83ad-42fe-8c6d-cea39680303e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:11.964847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:11.966142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:11.966636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:11.967061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] PATH_INFO: `/v3/projects/4e2e8d39c6654c11b2680eb007564ac1/users/c4d03040347345b3a0539ef3a3e0507a/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:11.998726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2e8d39c6654c11b2680eb007564ac1, user_id=c4d03040347345b3a0539ef3a3e0507a, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:12.001778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:12.042134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1050/2095] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:11 2022] PUT /identity/v3/projects/4e2e8d39c6654c11b2680eb007564ac1/users/c4d03040347345b3a0539ef3a3e0507a/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:12.046235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:12.061453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c50e54-e971-4ec7-9bc1-91d2bbca6827 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:12.143573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c014c4a-94d0-413c-8971-45a36fa1c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:12.144444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014c4a-94d0-413c-8971-45a36fa1c2de admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:12.145078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014c4a-94d0-413c-8971-45a36fa1c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:12.145415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014c4a-94d0-413c-8971-45a36fa1c2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:12.146310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c014c4a-94d0-413c-8971-45a36fa1c2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:12.148793 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c014c4a-94d0-413c-8971-45a36fa1c2de admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:12.163761 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1046/2096] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:12.167841 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:12.181714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a65cf-1ff5-4ddb-b2a4-c6a12d1cce12 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:12.189997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:12.191858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:12.191858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:12.191858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] PATH_INFO: `/v3/projects/4e2e8d39c6654c11b2680eb007564ac1/users/c4d03040347345b3a0539ef3a3e0507a/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:12.194144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2e8d39c6654c11b2680eb007564ac1, user_id=c4d03040347345b3a0539ef3a3e0507a, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:12.197347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:12.213682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1051/2097] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:12 2022] PUT /identity/v3/projects/4e2e8d39c6654c11b2680eb007564ac1/users/c4d03040347345b3a0539ef3a3e0507a/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:12.225305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:12.225747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:12.226450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:12.273107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] MFA Rules not processed for user `c4d03040347345b3a0539ef3a3e0507a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:12.275247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:12.419600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1047/2098] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:12.624318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:12.626884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:12.716728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9b4e-bca8-4ac4-a22c-a8755c1d8643 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:12.724641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ee39f-81a0-4104-9a8a-39331ae6ed30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:12.725598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee39f-81a0-4104-9a8a-39331ae6ed30 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:12.726155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee39f-81a0-4104-9a8a-39331ae6ed30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:12.726268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee39f-81a0-4104-9a8a-39331ae6ed30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:12.741154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ee39f-81a0-4104-9a8a-39331ae6ed30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:12.743282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ee39f-81a0-4104-9a8a-39331ae6ed30 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:12.764668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1052/2099] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:16.832051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:16.834831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:16.932375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507966c1-95d2-4d0d-a9e8-bb3ae6a4db8a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:16.938982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:16.939744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:16.940278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:16.940653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] PATH_INFO: `/v3/users/9b90414ecea144f3bebd7f7fdec6259e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:16.942207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b90414ecea144f3bebd7f7fdec6259e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:16.944327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:16.962831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:17.014899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b90414ecea144f3bebd7f7fdec6259e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:17.024713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b90414ecea144f3bebd7f7fdec6259e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:17.025623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b90414ecea144f3bebd7f7fdec6259e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:17.026918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b90414ecea144f3bebd7f7fdec6259e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:17.047346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b90414ecea144f3bebd7f7fdec6259e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:17.075822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1048/2100] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:16 2022] DELETE /identity/v3/users/9b90414ecea144f3bebd7f7fdec6259e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:17.081060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9321ed-9b32-480d-a5ab-c63056c366ff None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:17.081559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9321ed-9b32-480d-a5ab-c63056c366ff None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:17.082595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9321ed-9b32-480d-a5ab-c63056c366ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:17.117555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-fa9321ed-9b32-480d-a5ab-c63056c366ff None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:17.119104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fa9321ed-9b32-480d-a5ab-c63056c366ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:17.200880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1053/2101] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:17.211130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:17.212892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:17.285893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29214a4d-dbf2-4707-b619-e8ef0b6ee46a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:17.292382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:17.293003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:17.293777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:17.293777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:17.304060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:17.305568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:17.316727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1049/2102] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:17.879553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9321ed-9b32-480d-a5ab-c63056c366ff None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:17.895953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9321ed-9b32-480d-a5ab-c63056c366ff None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:17.901424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622b5c0-be2d-45bc-8503-3b075152fdb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:17.902645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b5c0-be2d-45bc-8503-3b075152fdb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:17.903211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b5c0-be2d-45bc-8503-3b075152fdb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:17.903797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b5c0-be2d-45bc-8503-3b075152fdb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:17.906714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4622b5c0-be2d-45bc-8503-3b075152fdb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:17.959575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:17.962995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:17.980677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84739db3-a8a7-472a-958a-e3bca9b9688a service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:17.986113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:17.986861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:17.987227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:17.987716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] PATH_INFO: `/v3/projects/4efd390fd59e4d73ac77b167d50f0c45` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:17.989241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efd390fd59e4d73ac77b167d50f0c45)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:17.991491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.010512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622b5c0-be2d-45bc-8503-3b075152fdb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.012190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622b5c0-be2d-45bc-8503-3b075152fdb5 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.017502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:18.025732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1054/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:18.049563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efd390fd59e4d73ac77b167d50f0c45', 'request_id': 'req-4dfa2976-d447-455f-b341-f377b69d62db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:18.056744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efd390fd59e4d73ac77b167d50f0c45', 'request_id': 'req-4dfa2976-d447-455f-b341-f377b69d62db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:18.063039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efd390fd59e4d73ac77b167d50f0c45', 'request_id': 'req-4dfa2976-d447-455f-b341-f377b69d62db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:18.078945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] The token cache is being invalidate because project 4efd390fd59e4d73ac77b167d50f0c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:18.078945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:18.079755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4dfa2976-d447-455f-b341-f377b69d62db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:18.082011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1050/2104] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:17 2022] DELETE /identity/v3/projects/4efd390fd59e4d73ac77b167d50f0c45 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:18.087807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434f89-90fb-4763-b5d8-f6112f3b45f0 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.088323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434f89-90fb-4763-b5d8-f6112f3b45f0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.088576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434f89-90fb-4763-b5d8-f6112f3b45f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.119433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1b434f89-90fb-4763-b5d8-f6112f3b45f0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:18.122167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1b434f89-90fb-4763-b5d8-f6112f3b45f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.211026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1055/2105] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:18.218632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86d398-db2b-4d3f-85fa-64d870827f38 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.219479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86d398-db2b-4d3f-85fa-64d870827f38 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.219479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86d398-db2b-4d3f-85fa-64d870827f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.242146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6c86d398-db2b-4d3f-85fa-64d870827f38 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:18.243526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6c86d398-db2b-4d3f-85fa-64d870827f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.251850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1051/2106] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:18.256410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434f89-90fb-4763-b5d8-f6112f3b45f0 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.267767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434f89-90fb-4763-b5d8-f6112f3b45f0 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.274222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.274222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.274479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.274699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.275243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:18.275537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.277465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.296504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1056/2107] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:18.300902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86d398-db2b-4d3f-85fa-64d870827f38 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.310691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86d398-db2b-4d3f-85fa-64d870827f38 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.317423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.317938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.318217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.318601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.319368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.321895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.327641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:18.359442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1052/2108] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:18.363983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.377869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222a244-3cf3-434f-a0d4-a413cdcb9ef2 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.447820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.448677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.449051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.450052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.450985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.453302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.489851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1057/2109] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:18 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:18.493632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.508524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77dae-aedd-42d0-a260-93c490513f00 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.515018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.515648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.516343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.516343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.516896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.518902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.537868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1053/2110] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:18.539668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.554332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523aac-7f84-4ce0-a194-f4da8c0e4634 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.560631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2d24c-8725-47ad-8471-1da56825a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.561367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2d24c-8725-47ad-8471-1da56825a4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.561952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2d24c-8725-47ad-8471-1da56825a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.562149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2d24c-8725-47ad-8471-1da56825a4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.562898 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2d24c-8725-47ad-8471-1da56825a4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.565453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2d24c-8725-47ad-8471-1da56825a4ee admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.584270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.585137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1058/2111] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:18.597422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467abd25-8c30-4471-9654-a580820ccd95 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.604868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.606545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.606918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.607323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] PATH_INFO: `/v3/projects/b3d47ac688fd489abaa2f5cd369af548/users/ca6b5297b8a445daa90a329ac7adadff/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.626565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d47ac688fd489abaa2f5cd369af548, user_id=ca6b5297b8a445daa90a329ac7adadff, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.629784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.659118 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1054/2112] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:18 2022] PUT /identity/v3/projects/b3d47ac688fd489abaa2f5cd369af548/users/ca6b5297b8a445daa90a329ac7adadff/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:18.670637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.671021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.671386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.733608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] MFA Rules not processed for user `ca6b5297b8a445daa90a329ac7adadff`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:18.735589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.809627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:18.826521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1059/2113] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:18.835778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:18.837678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:18.921087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031308f5-2791-47be-8fe5-b1619ce747cb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:18.927502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a90f56-0b7d-4143-b37c-abbed3f37e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:18.928078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a90f56-0b7d-4143-b37c-abbed3f37e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:18.928413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a90f56-0b7d-4143-b37c-abbed3f37e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:18.929450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a90f56-0b7d-4143-b37c-abbed3f37e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:18.939838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a90f56-0b7d-4143-b37c-abbed3f37e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:18.941863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a90f56-0b7d-4143-b37c-abbed3f37e78 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:18.952989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1055/2114] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:20.134818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:20.138302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:20.265894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12041-4da3-4922-bb72-2dc6f8f5f7b8 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:20.280250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:20.281381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:20.281957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:20.282368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] PATH_INFO: `/v3/users/d77c141b7d6442f2ba8a13c68aaa0783` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:20.291923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77c141b7d6442f2ba8a13c68aaa0783)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:20.296199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:20.422062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77c141b7d6442f2ba8a13c68aaa0783'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:20.423214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77c141b7d6442f2ba8a13c68aaa0783'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:20.461874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77c141b7d6442f2ba8a13c68aaa0783'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:20.482818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77c141b7d6442f2ba8a13c68aaa0783'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:20.484556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77c141b7d6442f2ba8a13c68aaa0783'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:20.512042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1060/2115] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:20 2022] DELETE /identity/v3/users/d77c141b7d6442f2ba8a13c68aaa0783 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:20.519854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:20.521084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:20.521715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:20.562528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:20.567249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:20.715476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1056/2116] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:20.766644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:20.768503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:20.927875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46ca79-b01e-4ffa-8e95-5f9f1b1b4d28 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:20.957618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:20.967806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:20.972357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:20.972903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:21.008859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:21.027355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:21.048025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1061/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:22.183849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:22.186392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:22.207451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aee3f-b27b-453a-bd04-6698849226dd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:22.220355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:22.221112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:22.221388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:22.221655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] PATH_INFO: `/v3/projects/2bbacaba483541a7b2fe514bd4979b7f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:22.225342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbacaba483541a7b2fe514bd4979b7f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:22.231066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:22.336596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbacaba483541a7b2fe514bd4979b7f', 'request_id': 'req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.337988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:22.354347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbacaba483541a7b2fe514bd4979b7f', 'request_id': 'req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.370782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbacaba483541a7b2fe514bd4979b7f', 'request_id': 'req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.397467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] The token cache is being invalidate because project 2bbacaba483541a7b2fe514bd4979b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:22.397778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.398855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.406907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1057/2118] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:22 2022] DELETE /identity/v3/projects/2bbacaba483541a7b2fe514bd4979b7f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:22.409090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:22.424414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648554bb-0036-4f4f-b883-8ea1fac68d21 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:22.445529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:22.544693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:22.545785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:22.548256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:22.548779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] PATH_INFO: `/v3/users/c4d03040347345b3a0539ef3a3e0507a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:22.568805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d03040347345b3a0539ef3a3e0507a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:22.582653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:22.716247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d03040347345b3a0539ef3a3e0507a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.717569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d03040347345b3a0539ef3a3e0507a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.744999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d03040347345b3a0539ef3a3e0507a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.759302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d03040347345b3a0539ef3a3e0507a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.761705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f0b88efb-f3f5-4bea-b279-8ed0b44cb86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d03040347345b3a0539ef3a3e0507a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:22.788779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1062/2119] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:22 2022] DELETE /identity/v3/users/c4d03040347345b3a0539ef3a3e0507a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:23.773417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:23.775985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:23.803600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2b6b9-6b9f-494b-9859-c85f85c6e2e5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:23.983464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:24.001176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:24.001845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:24.003510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] PATH_INFO: `/v3/projects/4e2e8d39c6654c11b2680eb007564ac1` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:24.007274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2e8d39c6654c11b2680eb007564ac1)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:24.010862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:24.141142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2e8d39c6654c11b2680eb007564ac1', 'request_id': 'req-7489311c-3068-4d2c-8f9a-63a261a60403'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:24.151942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2e8d39c6654c11b2680eb007564ac1', 'request_id': 'req-7489311c-3068-4d2c-8f9a-63a261a60403'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:24.160655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2e8d39c6654c11b2680eb007564ac1', 'request_id': 'req-7489311c-3068-4d2c-8f9a-63a261a60403'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:24.192285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] The token cache is being invalidate because project 4e2e8d39c6654c11b2680eb007564ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:24.192869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:24.193537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7489311c-3068-4d2c-8f9a-63a261a60403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:24.204736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1058/2120] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:23 2022] DELETE /identity/v3/projects/4e2e8d39c6654c11b2680eb007564ac1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:24.214372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cd36e-cc57-4ad6-807f-6001501de9ad None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:24.215223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cd36e-cc57-4ad6-807f-6001501de9ad None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:24.222114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cd36e-cc57-4ad6-807f-6001501de9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:24.303845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-139cd36e-cc57-4ad6-807f-6001501de9ad None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:24.305623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-139cd36e-cc57-4ad6-807f-6001501de9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:24.523790 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1063/2121] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:24.531695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216ac3-0ae6-4900-a2f5-36007e70af46 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:24.531980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216ac3-0ae6-4900-a2f5-36007e70af46 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:24.532253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216ac3-0ae6-4900-a2f5-36007e70af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:24.568072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6b216ac3-0ae6-4900-a2f5-36007e70af46 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:24.569418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6b216ac3-0ae6-4900-a2f5-36007e70af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:24.577842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1059/2122] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:24.583393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cd36e-cc57-4ad6-807f-6001501de9ad None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:24.600907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cd36e-cc57-4ad6-807f-6001501de9ad None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:24.614269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:24.615071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:24.615736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:24.616011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:24.616732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:24.617033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:24.618688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:24.653196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1064/2123] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:24.655209 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216ac3-0ae6-4900-a2f5-36007e70af46 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:24.668658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216ac3-0ae6-4900-a2f5-36007e70af46 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:24.675277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:24.675908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:24.676367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:24.676698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:24.677477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:24.679844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:24.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:24.748477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1060/2124] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:24 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:24.753414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f395-dd0c-4b40-938a-3bdfb2d9d85f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:24.791159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:24.854026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:24.855066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:24.855340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:24.855610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:24.856255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:24.858617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:24.893983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1065/2125] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:24 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:24.895851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:24.932596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59f532-e164-4f7b-a278-a5f0aa9a00e9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:24.944811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:24.945695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:24.946223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:24.946727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:24.947593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:24.956015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:24.985697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:24.989545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1061/2126] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:25.004021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838555c7-2eee-41cd-bd81-1662f1e23f40 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:25.014335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772cd7d-cf2d-4f09-8ac0-93900b45363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:25.016202 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772cd7d-cf2d-4f09-8ac0-93900b45363b admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:25.016888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772cd7d-cf2d-4f09-8ac0-93900b45363b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:25.017371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772cd7d-cf2d-4f09-8ac0-93900b45363b admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:25.018325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772cd7d-cf2d-4f09-8ac0-93900b45363b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:25.020334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772cd7d-cf2d-4f09-8ac0-93900b45363b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:25.056020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:25.066184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1066/2127] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:25.072362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397e2e-f7a4-44f5-9a63-faf1f22bda74 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:25.089926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:25.090899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:25.091384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:25.091866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] PATH_INFO: `/v3/projects/713cf0810b904ca1b51bbf75d92be7c7/users/18376b173fba4e76b5f0e3686da16d5a/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:25.110507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713cf0810b904ca1b51bbf75d92be7c7, user_id=18376b173fba4e76b5f0e3686da16d5a, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:25.113851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:25.138044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1062/2128] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:25 2022] PUT /identity/v3/projects/713cf0810b904ca1b51bbf75d92be7c7/users/18376b173fba4e76b5f0e3686da16d5a/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:25.148768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59851-217a-4556-aec4-42de97f3fec4 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:25.149048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59851-217a-4556-aec4-42de97f3fec4 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:25.149320 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59851-217a-4556-aec4-42de97f3fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:25.202579 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4ce59851-217a-4556-aec4-42de97f3fec4 None None] MFA Rules not processed for user `18376b173fba4e76b5f0e3686da16d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:25.203866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4ce59851-217a-4556-aec4-42de97f3fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:25.347542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1067/2129] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:25.353364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:25.359378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:25.525506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5770a4-9ae0-49b1-b734-0f6830555164 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:25.533263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:25.534233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:25.534675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:25.535065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:25.535932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:25.539544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:25.647062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1063/2130] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:25.649354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59851-217a-4556-aec4-42de97f3fec4 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:25.668683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59851-217a-4556-aec4-42de97f3fec4 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:25.835363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:25.835759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:25.836024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:25.836384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:25.837831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:25.840154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:25.879184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1068/2131] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:25 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:25.881921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:25.897930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d44c-c164-4eda-8e52-87e75c69788d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:25.903857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:25.904983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:25.905307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:25.905902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:25.906531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:25.908287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:25.926999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1064/2132] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:25.929189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:25.951465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117391-044b-4d6a-8695-7844afee4a08 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:25.982393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:25.983888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:25.984017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:25.984996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] PATH_INFO: `/v3/projects/59225c8f21904db9adb17fa3e3ef823e/users/9a6133857c86456a8455ce55b242f3b2/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:26.019987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59225c8f21904db9adb17fa3e3ef823e, user_id=9a6133857c86456a8455ce55b242f3b2, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:26.025310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:26.042067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:26.067331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1069/2133] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:25 2022] PUT /identity/v3/projects/59225c8f21904db9adb17fa3e3ef823e/users/9a6133857c86456a8455ce55b242f3b2/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:26.068580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:26.081295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3dca1-bc12-4bc7-a92b-9dd88188262d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:26.194554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f27f62-3adb-4b58-8274-01ac3aa9c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:26.195088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f27f62-3adb-4b58-8274-01ac3aa9c230 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:26.195364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f27f62-3adb-4b58-8274-01ac3aa9c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:26.195631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f27f62-3adb-4b58-8274-01ac3aa9c230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:26.198340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f27f62-3adb-4b58-8274-01ac3aa9c230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:26.201550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f27f62-3adb-4b58-8274-01ac3aa9c230 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:26.240606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:26.241005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1065/2134] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:26.260496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6b6ff-1944-40a8-9977-4d1326594b03 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:26.281894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:26.282594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:26.283926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:26.284213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] PATH_INFO: `/v3/projects/59225c8f21904db9adb17fa3e3ef823e/users/9a6133857c86456a8455ce55b242f3b2/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:26.286702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59225c8f21904db9adb17fa3e3ef823e, user_id=9a6133857c86456a8455ce55b242f3b2, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:26.291338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:26.327672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1070/2135] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:26 2022] PUT /identity/v3/projects/59225c8f21904db9adb17fa3e3ef823e/users/9a6133857c86456a8455ce55b242f3b2/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:26.343621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:26.343912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:26.344408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:26.420882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] MFA Rules not processed for user `9a6133857c86456a8455ce55b242f3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:26.426005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:26.542654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:26.555584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1066/2136] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:26.576766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:26.579891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:26.728761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73188a4-64ed-4a39-a8a8-49255d0a8aa9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:26.740218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb47a16-1ce0-4d59-afb4-b8af11316497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:26.740901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb47a16-1ce0-4d59-afb4-b8af11316497 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:26.741175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb47a16-1ce0-4d59-afb4-b8af11316497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:26.741439 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb47a16-1ce0-4d59-afb4-b8af11316497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:26.758889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb47a16-1ce0-4d59-afb4-b8af11316497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:26.760346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb47a16-1ce0-4d59-afb4-b8af11316497 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:26.785206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1071/2137] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:26.880852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:26.882885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:26.986612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237a571-fef8-4ab1-a1a4-8614214c0ebe None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:26.996108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:26.996829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:26.997787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:26.997787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] PATH_INFO: `/v3/users/d6da1567b25f4d0a849e1377500d322b` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:26.999459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6da1567b25f4d0a849e1377500d322b)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:27.001661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:27.119932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6da1567b25f4d0a849e1377500d322b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:27.138962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6da1567b25f4d0a849e1377500d322b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:27.141894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6da1567b25f4d0a849e1377500d322b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:27.143044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6da1567b25f4d0a849e1377500d322b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:27.160918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6da1567b25f4d0a849e1377500d322b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:27.190190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1067/2138] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:26 2022] DELETE /identity/v3/users/d6da1567b25f4d0a849e1377500d322b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:27.190496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:27.191066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:27.191346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:27.253405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:27.258238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:27.416145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1072/2139] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:27.453340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:27.454853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:27.605917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531555-1519-495f-a43b-b03a7191ed1c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:27.615091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e329b-1ebc-4687-95e7-6d5e6a06f79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:27.615901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e329b-1ebc-4687-95e7-6d5e6a06f79c service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:27.621307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e329b-1ebc-4687-95e7-6d5e6a06f79c service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:27.621307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e329b-1ebc-4687-95e7-6d5e6a06f79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:27.644608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e329b-1ebc-4687-95e7-6d5e6a06f79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:27.646320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e329b-1ebc-4687-95e7-6d5e6a06f79c service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:27.672242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1068/2140] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:28.214682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:28.217187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:28.238659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a005-876f-479f-a23e-3e22f9857c16 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:28.245562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:28.246517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:28.246997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:28.247512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] PATH_INFO: `/v3/projects/40daf01efed840f6b798f6ce5cb171f9` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:28.256660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40daf01efed840f6b798f6ce5cb171f9)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:28.259327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:28.355564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40daf01efed840f6b798f6ce5cb171f9', 'request_id': 'req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:28.372960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40daf01efed840f6b798f6ce5cb171f9', 'request_id': 'req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:28.394461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40daf01efed840f6b798f6ce5cb171f9', 'request_id': 'req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:28.425411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] The token cache is being invalidate because project 40daf01efed840f6b798f6ce5cb171f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:28.425710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:28.426660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-588a8e2b-dccf-4d3c-ae5d-22d28d5ce85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:28.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1073/2141] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:28 2022] DELETE /identity/v3/projects/40daf01efed840f6b798f6ce5cb171f9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:28.437503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd6b59-65cb-44df-839a-0dfdbe55408f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:28.438481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd6b59-65cb-44df-839a-0dfdbe55408f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:28.438751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd6b59-65cb-44df-839a-0dfdbe55408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:28.472837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f9dd6b59-65cb-44df-839a-0dfdbe55408f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:28.478928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f9dd6b59-65cb-44df-839a-0dfdbe55408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:28.517129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:28.622951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1069/2142] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:28.625433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ab68-0788-4998-8626-1373fe2d0b4e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:28.625979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ab68-0788-4998-8626-1373fe2d0b4e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:28.626411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ab68-0788-4998-8626-1373fe2d0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:28.670843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c775ab68-0788-4998-8626-1373fe2d0b4e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:28.671944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c775ab68-0788-4998-8626-1373fe2d0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:28.694522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1074/2143] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:28.706372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd6b59-65cb-44df-839a-0dfdbe55408f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:28.730096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd6b59-65cb-44df-839a-0dfdbe55408f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:28.750389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:28.751352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:28.752122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:28.752611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:28.753658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:28.754288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:28.764753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:28.782213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1070/2144] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:28.786506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ab68-0788-4998-8626-1373fe2d0b4e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:28.794900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:28.801234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ab68-0788-4998-8626-1373fe2d0b4e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:28.809980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:28.811274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:28.811484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:28.811765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:28.812961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:28.815781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:28.874756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1075/2145] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:28 2022] POST /identity/v3/projects => generated 391 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:28.880796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:28.918533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161e08-1824-4df5-89ba-7f1dfd20cbc8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.056730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.058565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:29.118309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.120407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.121367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.121762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.122880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.127211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.187072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e3285-38d8-4714-9c99-c82274737c90 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.202442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.203189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.203468 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.203736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] PATH_INFO: `/v3/users/daa52c2dae4c406caded5ba32fabf708` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.205143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa52c2dae4c406caded5ba32fabf708)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.206907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.213848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1071/2146] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:28 2022] POST /identity/v3/users => generated 296 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:29.214051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.229813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08710632-b9dc-4b1c-ba53-66a8a4ef5c3d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.238601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.240142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.240864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.241375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.245700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.248646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.264341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1072/2147] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:29.268589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.280949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b7f8-37c7-4a07-b10f-9697e9cfe3e5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.287590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.288212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.288492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.289130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.289717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.291563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.295454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa52c2dae4c406caded5ba32fabf708'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:29.296419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa52c2dae4c406caded5ba32fabf708'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:29.312828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1073/2148] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:29.313765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.315340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa52c2dae4c406caded5ba32fabf708'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:29.325720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa52c2dae4c406caded5ba32fabf708'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:29.330352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b510-9177-44be-8a8f-5ad9bcedfb84 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.330489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8079c4bd-9c74-42d9-8fea-0d701a558e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa52c2dae4c406caded5ba32fabf708'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:29.336964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e52b1e-067a-428f-95ac-9f696343ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.338268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e52b1e-067a-428f-95ac-9f696343ac3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.338544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e52b1e-067a-428f-95ac-9f696343ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.338819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e52b1e-067a-428f-95ac-9f696343ac3c admin admin] PATH_INFO: `/v3/projects/1ee0d00573b64145b3d8f51c323dc44f/users/9e838d815c93442c9ee043e4021598b5/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.358781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1076/2149] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:29 2022] DELETE /identity/v3/users/daa52c2dae4c406caded5ba32fabf708 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:29.366336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e52b1e-067a-428f-95ac-9f696343ac3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0d00573b64145b3d8f51c323dc44f, user_id=9e838d815c93442c9ee043e4021598b5, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.369262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e52b1e-067a-428f-95ac-9f696343ac3c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.371309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.371942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.372410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.388402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1074/2150] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:29 2022] PUT /identity/v3/projects/1ee0d00573b64145b3d8f51c323dc44f/users/9e838d815c93442c9ee043e4021598b5/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:29.403353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.403623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.403881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.408571 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:29.412849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:29.445070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] MFA Rules not processed for user `9e838d815c93442c9ee043e4021598b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:29.447735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:29.504910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1077/2151] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:29.513765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.517233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:29.525608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:29.535190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:29.585202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1075/2152] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:29.587262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.592235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:29.626566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671e42-95fc-4309-b37e-b8df2a3d742f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.642821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.643600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.644542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.644816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.645464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.647580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.654657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111f6a-6d5e-4553-9baa-8bab4eb162ec None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.665537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.666966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.667200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.667471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.687829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.690730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.703661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1076/2153] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:29 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:29.707749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.713598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1078/2154] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:38:29.831334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317f585-c878-4350-99ab-5d501f215501 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.849389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.850876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.852094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.852548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.853368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.861533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.932833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1077/2155] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:29 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:29.936541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.946916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b2c5-3735-4f4a-90e8-d231e9958ab5 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.951679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.952356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.952717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.952988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:29.953689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:29.955412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:29.974722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1079/2156] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:29.977877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:29.990934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3ab2-7ae5-44fe-a53d-dc19ac41b906 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:29.997398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:29.998293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:29.998718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:29.999161 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] PATH_INFO: `/v3/projects/aa4af37c0e054384ae95a8aa214c2cc7/users/d5471e3b47734eaeb06fb7e66423ce92/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.022079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4af37c0e054384ae95a8aa214c2cc7, user_id=d5471e3b47734eaeb06fb7e66423ce92, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.025179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.051140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1078/2157] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:29 2022] PUT /identity/v3/projects/aa4af37c0e054384ae95a8aa214c2cc7/users/d5471e3b47734eaeb06fb7e66423ce92/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:30.055101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.065713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.070839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba817-6bb1-4f0f-82e7-36d13113070e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.072808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.240295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35afdc-e551-4388-a280-6a1d2aa7edca admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.248402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.249368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.250196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.250684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] PATH_INFO: `/v3/projects/99e2dc8eb7a146c3be4206fd2b3ccf7c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.253433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e2dc8eb7a146c3be4206fd2b3ccf7c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.257500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.259037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.259761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.260089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.261606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.262749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.269287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.298719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1080/2158] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:30.299960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.320057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73076592-5f4e-47b0-8e79-bf26440286f8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.330169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:30.335115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc43c3-ea77-4a57-adca-3af1199c7445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.335955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc43c3-ea77-4a57-adca-3af1199c7445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.336234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc43c3-ea77-4a57-adca-3af1199c7445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.336507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc43c3-ea77-4a57-adca-3af1199c7445 admin admin] PATH_INFO: `/v3/projects/aa4af37c0e054384ae95a8aa214c2cc7/users/d5471e3b47734eaeb06fb7e66423ce92/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.345545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc43c3-ea77-4a57-adca-3af1199c7445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4af37c0e054384ae95a8aa214c2cc7, user_id=d5471e3b47734eaeb06fb7e66423ce92, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.351131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc43c3-ea77-4a57-adca-3af1199c7445 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.360096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e2dc8eb7a146c3be4206fd2b3ccf7c', 'request_id': 'req-99946a77-a7d3-47ca-a4f2-af9b95db4104'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:30.374625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e2dc8eb7a146c3be4206fd2b3ccf7c', 'request_id': 'req-99946a77-a7d3-47ca-a4f2-af9b95db4104'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:30.389709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1081/2159] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:30 2022] PUT /identity/v3/projects/aa4af37c0e054384ae95a8aa214c2cc7/users/d5471e3b47734eaeb06fb7e66423ce92/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:30.389969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e2dc8eb7a146c3be4206fd2b3ccf7c', 'request_id': 'req-99946a77-a7d3-47ca-a4f2-af9b95db4104'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:30.392230 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.392646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.392918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.412493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] The token cache is being invalidate because project 99e2dc8eb7a146c3be4206fd2b3ccf7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:30.413281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:30.414543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-99946a77-a7d3-47ca-a4f2-af9b95db4104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:30.416578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1079/2160] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:30 2022] DELETE /identity/v3/projects/99e2dc8eb7a146c3be4206fd2b3ccf7c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:30.422254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ca3e-6884-471c-9836-61a0c1f94f1d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.422836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ca3e-6884-471c-9836-61a0c1f94f1d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.423195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ca3e-6884-471c-9836-61a0c1f94f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.443992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] MFA Rules not processed for user `d5471e3b47734eaeb06fb7e66423ce92`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:30.445128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.468887 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bcd6ca3e-6884-471c-9836-61a0c1f94f1d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:30.470431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bcd6ca3e-6884-471c-9836-61a0c1f94f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.587971 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1082/2161] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:30.600458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.602605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.626427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:30.667778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1080/2162] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:30.674442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a72421-52a1-467a-a3e2-09b7db956a36 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.674821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a72421-52a1-467a-a3e2-09b7db956a36 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.675122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a72421-52a1-467a-a3e2-09b7db956a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.721476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-30a72421-52a1-467a-a3e2-09b7db956a36 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:30.722783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-30a72421-52a1-467a-a3e2-09b7db956a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.751210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1081/2163] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:30.751968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a72421-52a1-467a-a3e2-09b7db956a36 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.772127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a72421-52a1-467a-a3e2-09b7db956a36 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.791786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.792438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.792710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.793609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.793609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:30.793933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.795577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.802910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11e45-e4ab-48ba-a56b-6fd26ae17edd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.811939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.812534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.812876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.813210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.817993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:30.822491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1082/2164] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:30.824654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.846670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce993-597d-476b-abfd-acecaa548aef admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:30.858771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:30.859404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:30.859677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:30.860141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:30.860647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.863405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:30.930393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1083/2165] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:30 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:30.934916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:30.975945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:30.977617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.006951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1083/2166] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:31.090877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6c2da-3f0b-465f-b757-83098b501fe1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.105197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.106131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.106556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.106999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.107794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.111302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.175904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1084/2167] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:30 2022] POST /identity/v3/users => generated 281 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:38:31.177018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:31.192821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c7faf-c284-49b5-ac58-d92f8c8d0787 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.203752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.204189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.204462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.204726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.205616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.207394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.241380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1084/2168] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:31.248943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:31.256185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:31.260649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082347a-cdb9-4ae5-a535-eb6b9a97118b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.266882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a036-2126-425f-b24c-ced815c8f8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.267551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a036-2126-425f-b24c-ced815c8f8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.267987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a036-2126-425f-b24c-ced815c8f8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.268620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a036-2126-425f-b24c-ced815c8f8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.269563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a036-2126-425f-b24c-ced815c8f8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.272461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a036-2126-425f-b24c-ced815c8f8f3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.305592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1085/2169] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:31.306831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:31.322849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f56e-cd14-452a-9422-28e0d070e2a4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.331140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.334058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.335142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.335685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] PATH_INFO: `/v3/projects/5d1d810fe36a4b779a81c14aec73f3b3/users/0a827e72ae034ed1a700d3c93342bccb/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.375399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d810fe36a4b779a81c14aec73f3b3, user_id=0a827e72ae034ed1a700d3c93342bccb, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.378560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.414297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1085/2170] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:31 2022] PUT /identity/v3/projects/5d1d810fe36a4b779a81c14aec73f3b3/users/0a827e72ae034ed1a700d3c93342bccb/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:31.420007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.420276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.420577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.454809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] MFA Rules not processed for user `0a827e72ae034ed1a700d3c93342bccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:31.456675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:31.568680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1086/2171] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:31.618821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:31.622533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:31.750808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43539f-d32a-4421-ae3c-d5eedc020e5f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.758495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa32f0-35a7-409b-8dad-5425ecdf6831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.759747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa32f0-35a7-409b-8dad-5425ecdf6831 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.765408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:31.766197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa32f0-35a7-409b-8dad-5425ecdf6831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.766774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa32f0-35a7-409b-8dad-5425ecdf6831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.767120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:31.782862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa32f0-35a7-409b-8dad-5425ecdf6831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.784852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa32f0-35a7-409b-8dad-5425ecdf6831 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:31.797911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1086/2172] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:31.949022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e4746-c655-47cf-a9a9-35503ed9bf27 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:31.956086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:31.957017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:31.957382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:31.957769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] PATH_INFO: `/v3/users/18376b173fba4e76b5f0e3686da16d5a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:31.959689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18376b173fba4e76b5f0e3686da16d5a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:31.962830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:32.048068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18376b173fba4e76b5f0e3686da16d5a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:32.067638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18376b173fba4e76b5f0e3686da16d5a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:32.068464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18376b173fba4e76b5f0e3686da16d5a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:32.069257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18376b173fba4e76b5f0e3686da16d5a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:32.083409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18376b173fba4e76b5f0e3686da16d5a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:32.104182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1087/2173] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:31 2022] DELETE /identity/v3/users/18376b173fba4e76b5f0e3686da16d5a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:32.109128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:32.109509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:32.109900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:32.126370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:32.140433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:32.141976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:32.233045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1087/2174] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:32.248894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:32.253130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:32.262873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:32.376885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b8113-6493-457a-a55c-443541b3ba3e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:32.381907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:32.382677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:32.383139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:32.383492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:32.399684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:32.403138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:32.422300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1088/2175] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:33.502447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:33.508267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:33.529066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2de89-d80d-467d-ae44-bd49be45d8aa None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:33.536360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:33.537405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:33.538001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:33.538411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] PATH_INFO: `/v3/projects/713cf0810b904ca1b51bbf75d92be7c7` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:33.539953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713cf0810b904ca1b51bbf75d92be7c7)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:33.542134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:33.672965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713cf0810b904ca1b51bbf75d92be7c7', 'request_id': 'req-5e1685aa-6e46-439d-926b-ddf7349a8225'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.682347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713cf0810b904ca1b51bbf75d92be7c7', 'request_id': 'req-5e1685aa-6e46-439d-926b-ddf7349a8225'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.698914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713cf0810b904ca1b51bbf75d92be7c7', 'request_id': 'req-5e1685aa-6e46-439d-926b-ddf7349a8225'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.718134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] The token cache is being invalidate because project 713cf0810b904ca1b51bbf75d92be7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:33.718844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.719589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.721524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1088/2176] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:33 2022] DELETE /identity/v3/projects/713cf0810b904ca1b51bbf75d92be7c7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:33.726551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:33.737324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c5bdb-648a-4107-a415-f26624013a45 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:33.831832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:33.832646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:33.833016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:33.833379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] PATH_INFO: `/v3/users/9a6133857c86456a8455ce55b242f3b2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:33.834947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6133857c86456a8455ce55b242f3b2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:33.837228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:33.943498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6133857c86456a8455ce55b242f3b2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.957582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6133857c86456a8455ce55b242f3b2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.959859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6133857c86456a8455ce55b242f3b2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.961219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6133857c86456a8455ce55b242f3b2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:33.995501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2465a9ce-e452-48ce-b6c9-5b0e71b72a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6133857c86456a8455ce55b242f3b2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:34.033885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1089/2177] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:33 2022] DELETE /identity/v3/users/9a6133857c86456a8455ce55b242f3b2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:34.571391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:34.573101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:34.589166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1685aa-6e46-439d-926b-ddf7349a8225 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:34.669114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:34.671015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:34.671500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:34.671996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] PATH_INFO: `/v3/projects/59225c8f21904db9adb17fa3e3ef823e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:34.673953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59225c8f21904db9adb17fa3e3ef823e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:34.676764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:34.726214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:34.748749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59225c8f21904db9adb17fa3e3ef823e', 'request_id': 'req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:34.760596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59225c8f21904db9adb17fa3e3ef823e', 'request_id': 'req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:34.774446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59225c8f21904db9adb17fa3e3ef823e', 'request_id': 'req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:34.792045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] The token cache is being invalidate because project 59225c8f21904db9adb17fa3e3ef823e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:34.792589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:34.794071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cffb1907-6aff-4f0a-9e42-f36a1dea19b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:34.797048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1089/2178] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:34 2022] DELETE /identity/v3/projects/59225c8f21904db9adb17fa3e3ef823e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:34.802593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30d10-271d-4c18-82c8-3ee8a648a71f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:34.803734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30d10-271d-4c18-82c8-3ee8a648a71f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:34.804155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30d10-271d-4c18-82c8-3ee8a648a71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:34.829819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c0e30d10-271d-4c18-82c8-3ee8a648a71f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:34.833369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c0e30d10-271d-4c18-82c8-3ee8a648a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:34.859993 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:34.921786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1090/2179] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:34.930473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddb2bc-79c6-483b-8f11-673f15722dac None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:34.931216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddb2bc-79c6-483b-8f11-673f15722dac None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:34.931609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddb2bc-79c6-483b-8f11-673f15722dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:34.956094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f4ddb2bc-79c6-483b-8f11-673f15722dac None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:34.957660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f4ddb2bc-79c6-483b-8f11-673f15722dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:34.968224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1090/2180] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:34.972995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30d10-271d-4c18-82c8-3ee8a648a71f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:34.988670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30d10-271d-4c18-82c8-3ee8a648a71f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:34.994240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:34.996143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:34.996605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:34.997070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:34.997890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:34.998334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:35.000151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:35.016029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1091/2181] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:38:35.020509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddb2bc-79c6-483b-8f11-673f15722dac None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:35.033198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddb2bc-79c6-483b-8f11-673f15722dac None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:35.039066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:35.039942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:35.040346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:35.040716 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:35.041619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:35.043689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:35.084092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1091/2182] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:35 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:35.088143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:35.098889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5529a5-6d3b-4394-a541-663534095046 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:35.194857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:35.195646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:35.196065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:35.196428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:35.197177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:35.200253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:35.229027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1092/2183] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:35 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:35.232748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:35.245730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c05f-4294-4dab-bdd6-99ba08494870 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:35.253443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:35.254663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:35.255208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:35.255714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:35.256812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:35.258854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:35.272740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1092/2184] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:35.276816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:35.289437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d2c0-39ea-476c-b653-3d3aed9f07c4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:35.295474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6befc7-547c-4513-b170-c4868dd56a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:35.296799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6befc7-547c-4513-b170-c4868dd56a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:35.297406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6befc7-547c-4513-b170-c4868dd56a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:35.298005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6befc7-547c-4513-b170-c4868dd56a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:35.298976 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6befc7-547c-4513-b170-c4868dd56a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:35.301769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6befc7-547c-4513-b170-c4868dd56a25 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:35.317393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1093/2185] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:35.322195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:35.337611 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae10c5-67c9-4221-a359-2976e6923036 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:35.344598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:35.346601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:35.347102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:35.347728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] PATH_INFO: `/v3/projects/d14cf3e7557c4df6aadf7ebd13b7fdd9/users/645cfc975aac4448a22c27ea4404a78a/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:35.388889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14cf3e7557c4df6aadf7ebd13b7fdd9, user_id=645cfc975aac4448a22c27ea4404a78a, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:35.395382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:35.427308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1093/2186] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:35 2022] PUT /identity/v3/projects/d14cf3e7557c4df6aadf7ebd13b7fdd9/users/645cfc975aac4448a22c27ea4404a78a/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:35.438631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5b5a-f9bf-4b2e-a7ec-d7ec590cf814 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:35.438990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5b5a-f9bf-4b2e-a7ec-d7ec590cf814 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:35.439198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5b5a-f9bf-4b2e-a7ec-d7ec590cf814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:35.490540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-907a5b5a-f9bf-4b2e-a7ec-d7ec590cf814 None None] MFA Rules not processed for user `645cfc975aac4448a22c27ea4404a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:35.493703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-907a5b5a-f9bf-4b2e-a7ec-d7ec590cf814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:35.621376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1094/2187] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:35.640972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:35.643842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:35.756436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec9e5-b154-4c42-8178-eaf1ea2c48ba admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:35.763862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015399a2-6ffc-4bd4-ac83-2cf36363a8f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:35.763862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015399a2-6ffc-4bd4-ac83-2cf36363a8f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:35.764853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015399a2-6ffc-4bd4-ac83-2cf36363a8f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:35.764980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015399a2-6ffc-4bd4-ac83-2cf36363a8f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:35.781959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015399a2-6ffc-4bd4-ac83-2cf36363a8f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:35.783732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015399a2-6ffc-4bd4-ac83-2cf36363a8f9 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:35.798276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1094/2188] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:39.082861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5b5a-f9bf-4b2e-a7ec-d7ec590cf814 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:39.093785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5b5a-f9bf-4b2e-a7ec-d7ec590cf814 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:39.104192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:39.104872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:39.105094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:39.105359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:39.112588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:39.145991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:39.198506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:39.200072 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:39.214496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1095/2189] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:45.791216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:46.369728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6e06-35ac-49a8-9e8d-43c9f18b7c70 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:46.370537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6e06-35ac-49a8-9e8d-43c9f18b7c70 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:46.371006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6e06-35ac-49a8-9e8d-43c9f18b7c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:46.402772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-53cf6e06-35ac-49a8-9e8d-43c9f18b7c70 None None] MFA Rules not processed for user `9e838d815c93442c9ee043e4021598b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:46.405490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-53cf6e06-35ac-49a8-9e8d-43c9f18b7c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:46.482663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1095/2190] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:49.207404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=21 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:53.293255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:53.295099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:53.448872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8ccb0-8bde-40e3-acd9-16145dac05b5 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:53.455840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:53.456752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:53.457313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:53.457750 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] PATH_INFO: `/v3/users/ca6b5297b8a445daa90a329ac7adadff` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:53.459605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6b5297b8a445daa90a329ac7adadff)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:53.462057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:53.545122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6b5297b8a445daa90a329ac7adadff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:53.553598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6b5297b8a445daa90a329ac7adadff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:53.554661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6b5297b8a445daa90a329ac7adadff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:53.555338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6b5297b8a445daa90a329ac7adadff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:53.569329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6b5297b8a445daa90a329ac7adadff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:53.592062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1096/2191] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:38:53 2022] DELETE /identity/v3/users/ca6b5297b8a445daa90a329ac7adadff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:53.593686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:53.594213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:53.594371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:53.617030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:53.618345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:53.703261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1096/2192] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:53.709045 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:53.710659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:53.783266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765f692-90b2-4643-8c8a-7edfdfa19adf admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:53.788293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea16117-1dee-40de-b5ec-21f566b5c063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:53.789006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea16117-1dee-40de-b5ec-21f566b5c063 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:53.789344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea16117-1dee-40de-b5ec-21f566b5c063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:53.789672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea16117-1dee-40de-b5ec-21f566b5c063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:53.807953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea16117-1dee-40de-b5ec-21f566b5c063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:53.809693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea16117-1dee-40de-b5ec-21f566b5c063 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:53.821151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1097/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:38:54.033599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.035656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:54.051084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0be2fb-7d4f-4532-9ad1-178c95a88d05 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.058052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.059528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.060147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.060640 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] PATH_INFO: `/v3/projects/b3d47ac688fd489abaa2f5cd369af548` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.062460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d47ac688fd489abaa2f5cd369af548)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:54.064916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:54.124513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d47ac688fd489abaa2f5cd369af548', 'request_id': 'req-dab4391b-7079-4b12-96ed-a13be6a977c9'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:54.133331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d47ac688fd489abaa2f5cd369af548', 'request_id': 'req-dab4391b-7079-4b12-96ed-a13be6a977c9'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:54.143329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d47ac688fd489abaa2f5cd369af548', 'request_id': 'req-dab4391b-7079-4b12-96ed-a13be6a977c9'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:54.167994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] The token cache is being invalidate because project b3d47ac688fd489abaa2f5cd369af548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:38:54.169034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:54.169390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-dab4391b-7079-4b12-96ed-a13be6a977c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:38:54.178413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1097/2194] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:38:54 2022] DELETE /identity/v3/projects/b3d47ac688fd489abaa2f5cd369af548 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:38:54.179068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e146-2b74-4c7e-967c-708bd7e1e2e6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.179350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e146-2b74-4c7e-967c-708bd7e1e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.179653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e146-2b74-4c7e-967c-708bd7e1e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.206195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1462e146-2b74-4c7e-967c-708bd7e1e2e6 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:54.207194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1462e146-2b74-4c7e-967c-708bd7e1e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:54.236084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:54.344214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1098/2195] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:54.352003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ad18-b815-4abe-afb8-3214a47a6c17 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.352715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ad18-b815-4abe-afb8-3214a47a6c17 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.352715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ad18-b815-4abe-afb8-3214a47a6c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.380954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e743ad18-b815-4abe-afb8-3214a47a6c17 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:54.382404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e743ad18-b815-4abe-afb8-3214a47a6c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:54.397361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462e146-2b74-4c7e-967c-708bd7e1e2e6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.398180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1098/2196] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:38:54.409175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462e146-2b74-4c7e-967c-708bd7e1e2e6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.416555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.417068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.417425 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.418101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.418858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:38:54.419326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:54.421504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:54.441390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743ad18-b815-4abe-afb8-3214a47a6c17 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.448339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1099/2197] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:38:54.453664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743ad18-b815-4abe-afb8-3214a47a6c17 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.476005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483fc61-753d-4c2e-9748-57dee30cddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.478354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fc61-753d-4c2e-9748-57dee30cddcd admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.479091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fc61-753d-4c2e-9748-57dee30cddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.480036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fc61-753d-4c2e-9748-57dee30cddcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.480880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483fc61-753d-4c2e-9748-57dee30cddcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:54.487718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483fc61-753d-4c2e-9748-57dee30cddcd admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:54.550476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:54.570733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1099/2198] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:38:54 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:54.571489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.594011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07e54d-843b-44ec-b8c9-f7550973cba7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.684079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48a59-059c-447b-a249-8ce59e857bbf None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.684630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48a59-059c-447b-a249-8ce59e857bbf None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.685926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48a59-059c-447b-a249-8ce59e857bbf None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.687903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1100/2199] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 30 09:38:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:38:54.696512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79fdc-011b-40c8-af69-8e283dd1470b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.697879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79fdc-011b-40c8-af69-8e283dd1470b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.698420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79fdc-011b-40c8-af69-8e283dd1470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.708507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.709239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.709518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.709810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.710477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:54.712745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:54.743107 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-49d79fdc-011b-40c8-af69-8e283dd1470b None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:54.747557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-49d79fdc-011b-40c8-af69-8e283dd1470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:54.751810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1100/2200] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:38:54 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:38:54.759029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.807166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02ec29-5a03-4bb2-8661-6062f6627d39 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.819884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.822979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.822979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.822979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.822979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:54.824570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:54.844571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1101/2201] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:38:54.848788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.861839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da8965-c232-493c-9f2b-5c1eaa467afc admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.870392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.871004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.871382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.871873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.872682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:54.875159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:54.888786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1102/2202] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:38:54.892398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.909319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f2e95-608b-440d-938d-e2aa0ddcb7bd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.924143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fdd57-1318-48b0-a38d-aae10f900c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.926206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fdd57-1318-48b0-a38d-aae10f900c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.926515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fdd57-1318-48b0-a38d-aae10f900c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.926853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fdd57-1318-48b0-a38d-aae10f900c2e admin admin] PATH_INFO: `/v3/projects/c9385659f15746b4891169c55d333183/users/278db51b544f49bab4758cf327ce8487/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.949674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1101/2203] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:54.965573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79fdc-011b-40c8-af69-8e283dd1470b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:54.967996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fdd57-1318-48b0-a38d-aae10f900c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9385659f15746b4891169c55d333183, user_id=278db51b544f49bab4758cf327ce8487, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:54.971135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fdd57-1318-48b0-a38d-aae10f900c2e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:54.979258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79fdc-011b-40c8-af69-8e283dd1470b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:54.985697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:54.986839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:54.987204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:54.987659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:54.990130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:54.995340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1103/2204] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:38:54 2022] PUT /identity/v3/projects/c9385659f15746b4891169c55d333183/users/278db51b544f49bab4758cf327ce8487/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:38:55.007031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:55.007313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:55.007588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:55.017316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:55.019216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:55.032317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1102/2205] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:38:55.075012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] MFA Rules not processed for user `278db51b544f49bab4758cf327ce8487`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:38:55.076767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:55.163155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:38:55.197168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1104/2206] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:38:55.229787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:38:55.231430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:38:55.322448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf8903-0a8d-43c6-810c-84ce6ebc5fa7 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:38:55.390789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a2f52-b6ee-4c81-b68a-ee5216383ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:38:55.393946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2f52-b6ee-4c81-b68a-ee5216383ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:38:55.394668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2f52-b6ee-4c81-b68a-ee5216383ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:38:55.395597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2f52-b6ee-4c81-b68a-ee5216383ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:38:55.413461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a2f52-b6ee-4c81-b68a-ee5216383ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:38:55.416167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a2f52-b6ee-4c81-b68a-ee5216383ca6 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:38:55.433858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1103/2207] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:38:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:05.194591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=8 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:05.422116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=81 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:06.869869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:06.873640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:06.979450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35c77-1016-4514-bf8f-203d6953a14b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:06.987486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:06.989220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:06.989562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:06.993019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] PATH_INFO: `/v3/users/645cfc975aac4448a22c27ea4404a78a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:07.002871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=645cfc975aac4448a22c27ea4404a78a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:07.007120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:07.078986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645cfc975aac4448a22c27ea4404a78a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:07.104556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645cfc975aac4448a22c27ea4404a78a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:07.104556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645cfc975aac4448a22c27ea4404a78a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:07.104556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645cfc975aac4448a22c27ea4404a78a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:07.124531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645cfc975aac4448a22c27ea4404a78a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:07.150205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1105/2208] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:39:06 2022] DELETE /identity/v3/users/645cfc975aac4448a22c27ea4404a78a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:07.155029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:07.155536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:07.155639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:07.192282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:07.195035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:07.338337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1104/2209] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:07.353661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:07.357410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:07.503970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4550c-b478-4dc9-8496-b1afb7b32e88 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:07.509582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74572-e252-4e4d-919b-caa2e62abad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:07.510848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74572-e252-4e4d-919b-caa2e62abad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:07.511329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74572-e252-4e4d-919b-caa2e62abad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:07.512735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74572-e252-4e4d-919b-caa2e62abad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:07.543893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74572-e252-4e4d-919b-caa2e62abad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:07.547607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74572-e252-4e4d-919b-caa2e62abad8 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:07.569733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1106/2210] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:08.041830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:08.043576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:08.094006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f619d-c19e-402a-96ae-ea1621fcc2ec None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:08.106172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:08.109129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:08.109639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:08.110093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] PATH_INFO: `/v3/projects/d14cf3e7557c4df6aadf7ebd13b7fdd9` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:08.111604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14cf3e7557c4df6aadf7ebd13b7fdd9)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:08.116059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:08.230853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14cf3e7557c4df6aadf7ebd13b7fdd9', 'request_id': 'req-c66a1e14-ce05-4e77-8382-98e4a30f9aae'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:08.241011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14cf3e7557c4df6aadf7ebd13b7fdd9', 'request_id': 'req-c66a1e14-ce05-4e77-8382-98e4a30f9aae'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:08.260658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14cf3e7557c4df6aadf7ebd13b7fdd9', 'request_id': 'req-c66a1e14-ce05-4e77-8382-98e4a30f9aae'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:08.283831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] The token cache is being invalidate because project d14cf3e7557c4df6aadf7ebd13b7fdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:39:08.285334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:08.286750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c66a1e14-ce05-4e77-8382-98e4a30f9aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:08.294016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1105/2211] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:39:08 2022] DELETE /identity/v3/projects/d14cf3e7557c4df6aadf7ebd13b7fdd9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:08.295312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34010c-024c-4126-bded-815974fb9ca2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:08.295790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34010c-024c-4126-bded-815974fb9ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:08.296035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34010c-024c-4126-bded-815974fb9ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:08.331053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7a34010c-024c-4126-bded-815974fb9ca2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:08.332648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7a34010c-024c-4126-bded-815974fb9ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:08.418953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:08.582803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd21a-4e70-4f68-a7ce-6381a9ec098b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:08.583089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd21a-4e70-4f68-a7ce-6381a9ec098b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:08.583503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd21a-4e70-4f68-a7ce-6381a9ec098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:08.601805 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1107/2212] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:39:08.621297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d05fd21a-4e70-4f68-a7ce-6381a9ec098b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:08.622943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d05fd21a-4e70-4f68-a7ce-6381a9ec098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:08.645218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34010c-024c-4126-bded-815974fb9ca2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:08.655525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1106/2213] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:08.662889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34010c-024c-4126-bded-815974fb9ca2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:08.673872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:08.674958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:08.675723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:08.676294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:08.677160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:39:08.677537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:08.680335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:08.706724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd21a-4e70-4f68-a7ce-6381a9ec098b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:08.708213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1108/2214] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:39:08.723720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd21a-4e70-4f68-a7ce-6381a9ec098b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:08.731650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:08.732357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:08.732695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:08.733090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:08.733844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:08.737061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:08.813311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1107/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:39:08 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:39:08.814717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:08.832969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d79b67-146f-4b15-af47-a39159f85ac0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:08.969883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:08.972099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:08.972570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:08.974415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:08.975279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:08.980428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:09.023780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:09.024290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1109/2216] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:39:08 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:39:09.039923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83907ed-038d-4572-bc22-3a18fca27ac4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:09.046459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:09.047276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:09.047691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:09.048106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:09.048935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:09.051785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:09.066608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1108/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:39:09.072043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:09.103556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0500c-fa32-480c-a8a7-26a9ef3100a2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:09.113276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490af36-d8e2-4c1f-838c-84d7b1e1d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:09.114706 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490af36-d8e2-4c1f-838c-84d7b1e1d014 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:09.116908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490af36-d8e2-4c1f-838c-84d7b1e1d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:09.116908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490af36-d8e2-4c1f-838c-84d7b1e1d014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:09.120388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490af36-d8e2-4c1f-838c-84d7b1e1d014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:09.122369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490af36-d8e2-4c1f-838c-84d7b1e1d014 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:09.157284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:09.161389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1110/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:39:09.177921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db516-2c5e-4092-b3f8-333e7c07b09f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:09.183494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:09.184395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:09.184807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:09.185231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] PATH_INFO: `/v3/projects/712c063a226945b2a16140520fcee12d/users/8350d290d0124d4cb892705cbbb66909/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:09.202820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712c063a226945b2a16140520fcee12d, user_id=8350d290d0124d4cb892705cbbb66909, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:09.205972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:09.235660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1109/2219] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:39:09 2022] PUT /identity/v3/projects/712c063a226945b2a16140520fcee12d/users/8350d290d0124d4cb892705cbbb66909/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:09.247585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:09.248104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:09.248904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:09.303438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] MFA Rules not processed for user `8350d290d0124d4cb892705cbbb66909`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:09.306291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:09.497396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1111/2220] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:09.514480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:09.518418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:09.572367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:09.658590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe188da-8252-491a-b47e-086c3b5082f4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:09.663907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c11569-8fd8-4c39-9374-0abca439fe49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:09.664547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11569-8fd8-4c39-9374-0abca439fe49 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:09.664820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11569-8fd8-4c39-9374-0abca439fe49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:09.665171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11569-8fd8-4c39-9374-0abca439fe49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:09.680906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c11569-8fd8-4c39-9374-0abca439fe49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:09.682527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c11569-8fd8-4c39-9374-0abca439fe49 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:09.697119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1110/2221] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:16.536250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:16.539013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:16.595175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:16.697276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488e977-8043-4ff3-ab29-437d69e65ed6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:16.708191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:16.710495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:16.711042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:16.712068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] PATH_INFO: `/v3/users/278db51b544f49bab4758cf327ce8487` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:16.713989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=278db51b544f49bab4758cf327ce8487)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:16.717521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:16.828154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278db51b544f49bab4758cf327ce8487'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:16.836958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278db51b544f49bab4758cf327ce8487'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:16.838373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278db51b544f49bab4758cf327ce8487'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:16.839088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278db51b544f49bab4758cf327ce8487'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:16.857135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278db51b544f49bab4758cf327ce8487'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:16.893836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1112/2222] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:39:16 2022] DELETE /identity/v3/users/278db51b544f49bab4758cf327ce8487 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:16.895696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:16.897505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:16.897983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:16.924547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:16.926739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:17.027318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1111/2223] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:17.055799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:17.057772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:17.171925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073265a4-340d-440c-a9cf-0d103a988d41 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:17.184729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f52397-8ef3-4978-83b5-0b1c8900f5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:17.185539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52397-8ef3-4978-83b5-0b1c8900f5fb service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:17.185938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52397-8ef3-4978-83b5-0b1c8900f5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:17.187013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52397-8ef3-4978-83b5-0b1c8900f5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:17.211120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f52397-8ef3-4978-83b5-0b1c8900f5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:17.213385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f52397-8ef3-4978-83b5-0b1c8900f5fb service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:17.238695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1113/2224] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:17.841705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:17.845471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:17.882625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74b9a-2763-4335-b33d-f7ad9ef1d48a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:17.890448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:17.891157 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:17.891685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:17.891962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] PATH_INFO: `/v3/projects/c9385659f15746b4891169c55d333183` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:17.893296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9385659f15746b4891169c55d333183)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:17.895885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:18.025265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9385659f15746b4891169c55d333183', 'request_id': 'req-d2daf746-4f26-4134-aaec-3431e6bfb3b3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:18.042196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9385659f15746b4891169c55d333183', 'request_id': 'req-d2daf746-4f26-4134-aaec-3431e6bfb3b3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:18.059708 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9385659f15746b4891169c55d333183', 'request_id': 'req-d2daf746-4f26-4134-aaec-3431e6bfb3b3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:18.081423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] The token cache is being invalidate because project c9385659f15746b4891169c55d333183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:39:18.082748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:18.084099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d2daf746-4f26-4134-aaec-3431e6bfb3b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:18.090510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1112/2225] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:39:17 2022] DELETE /identity/v3/projects/c9385659f15746b4891169c55d333183 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:18.092039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90336-f13c-4298-9763-f7b7c8b0cc3f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.092928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90336-f13c-4298-9763-f7b7c8b0cc3f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.093405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90336-f13c-4298-9763-f7b7c8b0cc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.130081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fcb90336-f13c-4298-9763-f7b7c8b0cc3f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:18.131492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fcb90336-f13c-4298-9763-f7b7c8b0cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:18.201696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:18.252237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1114/2226] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:39:18.260531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc545-bb71-4c36-884f-28160ebbf32d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.261222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc545-bb71-4c36-884f-28160ebbf32d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.261500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc545-bb71-4c36-884f-28160ebbf32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.294932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f14bc545-bb71-4c36-884f-28160ebbf32d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:18.296251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f14bc545-bb71-4c36-884f-28160ebbf32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:18.312604 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1113/2227] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:18.317316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90336-f13c-4298-9763-f7b7c8b0cc3f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:18.328581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90336-f13c-4298-9763-f7b7c8b0cc3f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:18.333742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:18.334509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.335018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.335349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.336067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:39:18.336437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:18.338220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:18.359442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1115/2228] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:39:18.364244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc545-bb71-4c36-884f-28160ebbf32d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:18.378147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc545-bb71-4c36-884f-28160ebbf32d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:18.386409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:18.387305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.388695 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.389154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.390112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:18.392856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:18.448060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1114/2229] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:39:18 2022] POST /identity/v3/projects => generated 361 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:39:18.449294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:18.465196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ff57-ff2e-468a-a312-f166817b2e38 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:18.563549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:18.565409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.565938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.566485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.567849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:18.571053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:18.605183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1116/2230] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:39:18 2022] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:39:18.611164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:18.627880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a46e-2b51-4a17-bb4a-dbba01924483 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:18.635483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:18.637519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.637948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.638684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.639058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:18.641133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:18.658150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1115/2231] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:39:18.659770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:18.674589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7f29f-1aee-407e-9d33-8fe38c64a075 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:18.685059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e57554-b5d2-4be6-a097-0679a24a6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:18.685771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e57554-b5d2-4be6-a097-0679a24a6234 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.686280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e57554-b5d2-4be6-a097-0679a24a6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.686620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e57554-b5d2-4be6-a097-0679a24a6234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.687348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e57554-b5d2-4be6-a097-0679a24a6234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:18.689111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e57554-b5d2-4be6-a097-0679a24a6234 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:18.722251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1117/2232] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:39:18.727149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:18.745087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286658df-f926-44f7-a942-49df05dc2fd7 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:18.751196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:18.752155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.752725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.753207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] PATH_INFO: `/v3/projects/a3d797cfdf3843fc847cb0d07ec0564a/users/7474f7e3ab7d4453883b0baeca5c3dff/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.756491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:18.788636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d797cfdf3843fc847cb0d07ec0564a, user_id=7474f7e3ab7d4453883b0baeca5c3dff, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:18.791625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:18.832357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1116/2233] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:39:18 2022] PUT /identity/v3/projects/a3d797cfdf3843fc847cb0d07ec0564a/users/7474f7e3ab7d4453883b0baeca5c3dff/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:18.842513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179a97-5f11-4d7d-a167-953109be09a2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:18.842796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179a97-5f11-4d7d-a167-953109be09a2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:18.843066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179a97-5f11-4d7d-a167-953109be09a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:18.902346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-51179a97-5f11-4d7d-a167-953109be09a2 None None] MFA Rules not processed for user `7474f7e3ab7d4453883b0baeca5c3dff`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:18.903945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-51179a97-5f11-4d7d-a167-953109be09a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:19.032329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1118/2234] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:19.085833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:19.087500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:19.195595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e1112-ee07-4ffd-939c-b412472f777b admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:19.201740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459d0c-0383-48cc-9e28-802fc51f139a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:19.202816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459d0c-0383-48cc-9e28-802fc51f139a service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:19.203390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459d0c-0383-48cc-9e28-802fc51f139a service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:19.203959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459d0c-0383-48cc-9e28-802fc51f139a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:19.223575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459d0c-0383-48cc-9e28-802fc51f139a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:19.225465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459d0c-0383-48cc-9e28-802fc51f139a service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:19.240563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1117/2235] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:29.023931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:29.233096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:37.585054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179a97-5f11-4d7d-a167-953109be09a2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:37.691451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179a97-5f11-4d7d-a167-953109be09a2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:37.697471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:37.698465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:37.698953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:37.699709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] PATH_INFO: `/v3/users/7474f7e3ab7d4453883b0baeca5c3dff` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:37.701055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7474f7e3ab7d4453883b0baeca5c3dff)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:37.703245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:37.832665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7474f7e3ab7d4453883b0baeca5c3dff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:37.842760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7474f7e3ab7d4453883b0baeca5c3dff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:37.845784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7474f7e3ab7d4453883b0baeca5c3dff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:37.849384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7474f7e3ab7d4453883b0baeca5c3dff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:37.882477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7474f7e3ab7d4453883b0baeca5c3dff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:37.915432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1119/2236] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:39:37 2022] DELETE /identity/v3/users/7474f7e3ab7d4453883b0baeca5c3dff => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:37.919942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:37.920433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:37.920537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:37.955995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:37.959232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:38.079924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1118/2237] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:39:38.096114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:38.100193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:38.200136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b1bb4-7b35-4ec1-beb0-e2dada5258f5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:38.207151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:38.222215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:38.222506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:38.222852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:38.236065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:38.237662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:38.253661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1120/2238] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:39.394386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:39.396364 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:39.417814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992d1e9-cf62-4a09-88e0-e91206bde089 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:39.430199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:39.431261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:39.431710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:39.431962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] PATH_INFO: `/v3/projects/a3d797cfdf3843fc847cb0d07ec0564a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:39.434713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d797cfdf3843fc847cb0d07ec0564a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:39.438295 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:39.508380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d797cfdf3843fc847cb0d07ec0564a', 'request_id': 'req-0f558b0f-40ab-439e-b406-ae668f788334'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:39.516053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d797cfdf3843fc847cb0d07ec0564a', 'request_id': 'req-0f558b0f-40ab-439e-b406-ae668f788334'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:39.532531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d797cfdf3843fc847cb0d07ec0564a', 'request_id': 'req-0f558b0f-40ab-439e-b406-ae668f788334'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:39.560325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] The token cache is being invalidate because project a3d797cfdf3843fc847cb0d07ec0564a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:39:39.562331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:39.563261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0f558b0f-40ab-439e-b406-ae668f788334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:39.565245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1119/2239] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:39:39 2022] DELETE /identity/v3/projects/a3d797cfdf3843fc847cb0d07ec0564a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:42.550765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:42.552487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:42.570848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2ec77-58ac-4227-bf0d-11354db11a57 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:42.624405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:42.679752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:42.680861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:42.681475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:42.682005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] PATH_INFO: `/v3/users/db9f48bc8a514f2daeb3dc7b50af83e2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:42.683474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9f48bc8a514f2daeb3dc7b50af83e2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:42.686229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:42.791899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9f48bc8a514f2daeb3dc7b50af83e2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:42.801745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9f48bc8a514f2daeb3dc7b50af83e2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:42.803071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9f48bc8a514f2daeb3dc7b50af83e2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:42.804365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9f48bc8a514f2daeb3dc7b50af83e2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:42.827970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9f48bc8a514f2daeb3dc7b50af83e2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:42.874177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1121/2240] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:39:42 2022] DELETE /identity/v3/users/db9f48bc8a514f2daeb3dc7b50af83e2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:42.874890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:42.875374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:42.875474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:42.913855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:42.915564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:43.027061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1120/2241] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:43.043570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:43.045198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:43.145638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92723f52-cbe7-4183-9490-0a22683a8c7a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:43.154396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99027a36-dfde-4c4a-b482-8628f9b76beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:43.156539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027a36-dfde-4c4a-b482-8628f9b76beb service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:43.156921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027a36-dfde-4c4a-b482-8628f9b76beb service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:43.157464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027a36-dfde-4c4a-b482-8628f9b76beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:43.171820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99027a36-dfde-4c4a-b482-8628f9b76beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:43.173970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99027a36-dfde-4c4a-b482-8628f9b76beb service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:43.202518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1122/2242] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:43.735906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:43.737831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:43.762624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50f61f-c57c-4436-914f-bf7f76e0a584 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:43.781951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:43.782626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:43.782907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:43.783173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] PATH_INFO: `/v3/projects/1ea68584c9494de5a7ff68917812b1a2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:43.786140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea68584c9494de5a7ff68917812b1a2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:43.788636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:43.818394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:43.853219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea68584c9494de5a7ff68917812b1a2', 'request_id': 'req-654c4403-4c7b-417e-bc69-1b1112600157'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:43.859910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea68584c9494de5a7ff68917812b1a2', 'request_id': 'req-654c4403-4c7b-417e-bc69-1b1112600157'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:43.869450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea68584c9494de5a7ff68917812b1a2', 'request_id': 'req-654c4403-4c7b-417e-bc69-1b1112600157'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:43.885018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] The token cache is being invalidate because project 1ea68584c9494de5a7ff68917812b1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:39:43.885731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:43.886223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-654c4403-4c7b-417e-bc69-1b1112600157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:39:43.888166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1121/2243] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:39:43 2022] DELETE /identity/v3/projects/1ea68584c9494de5a7ff68917812b1a2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:43.893382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793a76-a8b4-4703-8664-afb1b190ed25 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:43.894017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793a76-a8b4-4703-8664-afb1b190ed25 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:43.894017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793a76-a8b4-4703-8664-afb1b190ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:43.922113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-94793a76-a8b4-4703-8664-afb1b190ed25 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:43.923495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-94793a76-a8b4-4703-8664-afb1b190ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:43.972325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:43.998265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1123/2244] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:44.007526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047bf7b-70f1-4a02-b394-76dcd284543e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.008164 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047bf7b-70f1-4a02-b394-76dcd284543e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.008532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047bf7b-70f1-4a02-b394-76dcd284543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.033558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0047bf7b-70f1-4a02-b394-76dcd284543e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:44.035069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0047bf7b-70f1-4a02-b394-76dcd284543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:44.048607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1122/2245] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:44.050051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793a76-a8b4-4703-8664-afb1b190ed25 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:44.061956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793a76-a8b4-4703-8664-afb1b190ed25 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:44.068593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:44.069343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.069635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.069936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.070587 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:39:44.070902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:44.072772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:44.085906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1124/2246] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:39:44.089975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047bf7b-70f1-4a02-b394-76dcd284543e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:44.100203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047bf7b-70f1-4a02-b394-76dcd284543e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:44.106489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:44.107461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.107908 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.108322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.109117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:44.111385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:44.159087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1123/2247] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:39:44 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:39:44.160047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:44.172654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072f765-44a2-4d1a-97cc-b65db27a556d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:44.244864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:44.246064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.246918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.247395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.248258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:44.250901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:44.281010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1125/2248] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:39:44 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:39:44.285307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:44.296315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424467-58a0-4ff3-b161-1cec6199c795 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:44.301741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:44.302352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.302626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.302891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.303530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:44.305196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:44.317380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1124/2249] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:39:44.323016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:44.336348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c761ba-306a-4911-bc7b-9c595ad1da54 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:44.341485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf24f5-8048-4f30-be08-b1615a1b7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:44.342500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf24f5-8048-4f30-be08-b1615a1b7096 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.342845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf24f5-8048-4f30-be08-b1615a1b7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.343179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf24f5-8048-4f30-be08-b1615a1b7096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.344569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf24f5-8048-4f30-be08-b1615a1b7096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:44.346796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf24f5-8048-4f30-be08-b1615a1b7096 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:44.367451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1126/2250] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:39:44.372354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:44.383504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b913a-3744-4fdd-ab8f-c721a89428f8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:44.389416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:44.390141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.390414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.390684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] PATH_INFO: `/v3/projects/c86ee3138fba4b3ab6657c9c527e6852/users/1bbaac6c931245c8aadafd9a1289aaac/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.409457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86ee3138fba4b3ab6657c9c527e6852, user_id=1bbaac6c931245c8aadafd9a1289aaac, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:44.413033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:44.434048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1125/2251] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:39:44 2022] PUT /identity/v3/projects/c86ee3138fba4b3ab6657c9c527e6852/users/1bbaac6c931245c8aadafd9a1289aaac/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:39:44.444071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24397-3056-4cbd-8673-6a84b309b419 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.444327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24397-3056-4cbd-8673-6a84b309b419 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.444594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24397-3056-4cbd-8673-6a84b309b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.477300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e3d24397-3056-4cbd-8673-6a84b309b419 None None] MFA Rules not processed for user `1bbaac6c931245c8aadafd9a1289aaac`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:39:44.478751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e3d24397-3056-4cbd-8673-6a84b309b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:44.562447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1127/2252] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:39:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:39:44.573349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:39:44.575403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:39:44.648887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35718-49ba-44c9-9885-742892401bba admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:39:44.654003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dce44-baa8-42a8-8f9b-fcae486536a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:39:44.654878 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dce44-baa8-42a8-8f9b-fcae486536a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:39:44.655238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dce44-baa8-42a8-8f9b-fcae486536a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:39:44.656118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dce44-baa8-42a8-8f9b-fcae486536a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:39:44.667246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dce44-baa8-42a8-8f9b-fcae486536a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:39:44.668785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dce44-baa8-42a8-8f9b-fcae486536a4 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:39:44.681991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1126/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:39:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:39:54.559861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:39:54.674915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:06.437946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24397-3056-4cbd-8673-6a84b309b419 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:06.535146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24397-3056-4cbd-8673-6a84b309b419 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:06.540670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:06.541395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:06.541768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:06.542141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] PATH_INFO: `/v3/users/1bbaac6c931245c8aadafd9a1289aaac` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:06.543505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbaac6c931245c8aadafd9a1289aaac)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:06.546485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:06.655331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbaac6c931245c8aadafd9a1289aaac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:06.674283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbaac6c931245c8aadafd9a1289aaac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:06.675302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbaac6c931245c8aadafd9a1289aaac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:06.676217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbaac6c931245c8aadafd9a1289aaac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:06.701573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbaac6c931245c8aadafd9a1289aaac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:06.725178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1128/2254] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:06 2022] DELETE /identity/v3/users/1bbaac6c931245c8aadafd9a1289aaac => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:06.729622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:06.730162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:06.730162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:06.751382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:06.752921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:06.879404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1127/2255] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:06.936729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:06.939107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:07.077346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344d78-12ca-485a-b4e7-ffb168520ebc admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:07.081992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481ee8-87f4-489d-a5f1-9447e5dcfc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:07.082876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481ee8-87f4-489d-a5f1-9447e5dcfc60 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:07.083294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481ee8-87f4-489d-a5f1-9447e5dcfc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:07.083721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481ee8-87f4-489d-a5f1-9447e5dcfc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:07.095945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03481ee8-87f4-489d-a5f1-9447e5dcfc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:07.098948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03481ee8-87f4-489d-a5f1-9447e5dcfc60 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:07.113521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1129/2256] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:07.806830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:07.809484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:07.836150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbab13b-1160-4798-91e5-9799659f7998 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:07.866397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:07.867426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:07.868399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:07.868845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] PATH_INFO: `/v3/projects/c86ee3138fba4b3ab6657c9c527e6852` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:07.870201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86ee3138fba4b3ab6657c9c527e6852)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:07.874207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:07.987080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86ee3138fba4b3ab6657c9c527e6852', 'request_id': 'req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:07.998104 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86ee3138fba4b3ab6657c9c527e6852', 'request_id': 'req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:08.012933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86ee3138fba4b3ab6657c9c527e6852', 'request_id': 'req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:08.029979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] The token cache is being invalidate because project c86ee3138fba4b3ab6657c9c527e6852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:08.030279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:08.031155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5996bb50-c35e-4ee3-bdc8-d5e192c7d55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:08.036358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1128/2257] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:07 2022] DELETE /identity/v3/projects/c86ee3138fba4b3ab6657c9c527e6852 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:08.038119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da518b5-125b-4a52-b247-c1fc8512e645 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.038669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da518b5-125b-4a52-b247-c1fc8512e645 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.038669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da518b5-125b-4a52-b247-c1fc8512e645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.067318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6da518b5-125b-4a52-b247-c1fc8512e645 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:08.069113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6da518b5-125b-4a52-b247-c1fc8512e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:08.097963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:08.180737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1130/2258] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:08.181911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80855448-4144-4eed-8531-8c051a71597a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.182196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80855448-4144-4eed-8531-8c051a71597a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.182466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80855448-4144-4eed-8531-8c051a71597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.215485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-80855448-4144-4eed-8531-8c051a71597a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:08.216842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-80855448-4144-4eed-8531-8c051a71597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:08.231991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1129/2259] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:08.233416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da518b5-125b-4a52-b247-c1fc8512e645 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:08.247995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da518b5-125b-4a52-b247-c1fc8512e645 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:08.265582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:08.266514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.266514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.266876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.268003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:08.268435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:08.270150 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:08.298693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1131/2260] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:08.303056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80855448-4144-4eed-8531-8c051a71597a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:08.313945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80855448-4144-4eed-8531-8c051a71597a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:08.325235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:08.326070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.326343 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.326605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.327464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:08.331001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:08.383549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1130/2261] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:08 2022] POST /identity/v3/projects => generated 353 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:08.387934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:08.403376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4096-fd25-4706-bda6-43e47b17b700 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:08.479065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:08.479600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.479874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.480640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.481016 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:08.483286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:08.520667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1132/2262] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:08 2022] POST /identity/v3/users => generated 277 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:08.524875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:08.538491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126237a6-fce6-42f4-a312-57d0b6034c3c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:08.545335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:08.546047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.546324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.546595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.547701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:08.550284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:08.565642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1131/2263] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:08.576650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:08.594689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8a81-73a7-4c85-82bc-ff61db1d2e7a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:08.601389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826000f-7167-4d9a-bddb-4d0fe8cd2878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:08.602497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826000f-7167-4d9a-bddb-4d0fe8cd2878 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.603037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826000f-7167-4d9a-bddb-4d0fe8cd2878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.603501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826000f-7167-4d9a-bddb-4d0fe8cd2878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.604607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826000f-7167-4d9a-bddb-4d0fe8cd2878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:08.611782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826000f-7167-4d9a-bddb-4d0fe8cd2878 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:08.637637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1133/2264] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:08.638445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:08.657475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf776-24a0-4e3d-8c95-65a78a3f2e72 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:08.666517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:08.669163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.669163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.669163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] PATH_INFO: `/v3/projects/2b4c8a4daa9e4c26997e8f5bd1ec831a/users/91e121d1065f4898af1e3ebbfbf84968/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.699759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4c8a4daa9e4c26997e8f5bd1ec831a, user_id=91e121d1065f4898af1e3ebbfbf84968, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:08.703883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:08.737861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1132/2265] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:08 2022] PUT /identity/v3/projects/2b4c8a4daa9e4c26997e8f5bd1ec831a/users/91e121d1065f4898af1e3ebbfbf84968/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:08.744268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:08.744546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:08.744812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:08.822892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] MFA Rules not processed for user `91e121d1065f4898af1e3ebbfbf84968`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:08.822892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:08.974594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1134/2266] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:08.993564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:08.996039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:09.039407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:09.102383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb24c-ea12-4973-b618-f493f93ad879 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:09.106866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ad89-a1b2-4574-a2ac-2cb32dd453ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:09.109043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ad89-a1b2-4574-a2ac-2cb32dd453ec service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:09.109515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ad89-a1b2-4574-a2ac-2cb32dd453ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:09.110391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ad89-a1b2-4574-a2ac-2cb32dd453ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:09.125099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ad89-a1b2-4574-a2ac-2cb32dd453ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:09.128085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ad89-a1b2-4574-a2ac-2cb32dd453ec service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:09.140123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1133/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:09.879287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:09.886676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:09.931093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:10.017992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e1608-4b12-4ae4-9a74-e8b6ed354bf1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:10.023431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:10.024819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:10.025331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:10.025875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] PATH_INFO: `/v3/users/0a827e72ae034ed1a700d3c93342bccb` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:10.027306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a827e72ae034ed1a700d3c93342bccb)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:10.030029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:10.140934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a827e72ae034ed1a700d3c93342bccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:10.154774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a827e72ae034ed1a700d3c93342bccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:10.155548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a827e72ae034ed1a700d3c93342bccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:10.156167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a827e72ae034ed1a700d3c93342bccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:10.179343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a827e72ae034ed1a700d3c93342bccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:10.229391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1135/2268] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:09 2022] DELETE /identity/v3/users/0a827e72ae034ed1a700d3c93342bccb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:10.230861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:10.231248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:10.231394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:10.262872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:10.268232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:10.347985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1134/2269] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:10.360221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:10.365879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:10.470038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1137-7828-4ecc-9530-52d507d74032 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:10.474260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038c165-8f73-4480-a36e-26a5ba63836f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:10.474989 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c165-8f73-4480-a36e-26a5ba63836f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:10.475370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c165-8f73-4480-a36e-26a5ba63836f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:10.475734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c165-8f73-4480-a36e-26a5ba63836f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:10.518860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038c165-8f73-4480-a36e-26a5ba63836f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:10.520607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038c165-8f73-4480-a36e-26a5ba63836f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:10.543008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1136/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:11.352606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:11.354341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:11.371179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017767b3-53a9-4ddc-ab70-008bc798b995 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:11.383369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:11.384569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.384937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.385393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] PATH_INFO: `/v3/projects/5d1d810fe36a4b779a81c14aec73f3b3` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.387306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1d810fe36a4b779a81c14aec73f3b3)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:11.390465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:11.456568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1d810fe36a4b779a81c14aec73f3b3', 'request_id': 'req-9a2e0629-fb90-4702-baa7-2759de6bb64b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:11.464974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1d810fe36a4b779a81c14aec73f3b3', 'request_id': 'req-9a2e0629-fb90-4702-baa7-2759de6bb64b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:11.476758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1d810fe36a4b779a81c14aec73f3b3', 'request_id': 'req-9a2e0629-fb90-4702-baa7-2759de6bb64b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:11.490672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] The token cache is being invalidate because project 5d1d810fe36a4b779a81c14aec73f3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:11.491055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:11.491754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9a2e0629-fb90-4702-baa7-2759de6bb64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:11.493580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1135/2271] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:11 2022] DELETE /identity/v3/projects/5d1d810fe36a4b779a81c14aec73f3b3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:40:11.498612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3b79-56e6-45ac-ad3f-7bfebbedd26f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.499636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3b79-56e6-45ac-ad3f-7bfebbedd26f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.500198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3b79-56e6-45ac-ad3f-7bfebbedd26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.526649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0bcf3b79-56e6-45ac-ad3f-7bfebbedd26f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:11.528340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0bcf3b79-56e6-45ac-ad3f-7bfebbedd26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:11.573449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:11.607621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1137/2272] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:11.623046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81220-e235-4d70-adaa-6753301feeed None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.623621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81220-e235-4d70-adaa-6753301feeed None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.624077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81220-e235-4d70-adaa-6753301feeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.656905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c4d81220-e235-4d70-adaa-6753301feeed None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:11.658207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c4d81220-e235-4d70-adaa-6753301feeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:11.672557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1136/2273] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:11.675913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf3b79-56e6-45ac-ad3f-7bfebbedd26f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:11.692224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf3b79-56e6-45ac-ad3f-7bfebbedd26f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:11.699524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:11.700162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.701293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.701560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.702299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:11.702919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:11.704801 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:11.720608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1138/2274] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:11.724913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81220-e235-4d70-adaa-6753301feeed None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:11.734577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81220-e235-4d70-adaa-6753301feeed None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:11.739589 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:11.740208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.740478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.740743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.741433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:11.743545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:11.774970 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1137/2275] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:11 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:40:11.779085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:11.790373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4683ec-cabf-4bba-9bce-34b41356f995 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:11.864744 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:11.865401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.865640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.866112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.866670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:11.870388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:11.898630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1139/2276] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:11 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:11.904274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:11.915672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6072-ecc7-423b-99b3-cd18b866a239 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:11.920502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:11.921175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.921528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.921896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.922702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:11.924778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:11.941422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1138/2277] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:11.945530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:11.956472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c80f38-85ea-4a91-8f18-2a1d7b8741cd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:11.962459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:11.963250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:11.963692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:11.964132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:11.964922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:11.966732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:12.006229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1140/2278] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:12.007143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:12.026289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf34d6-b2bb-4b57-a0b1-22bbbf6b80fa admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:12.028781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:12.031185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:12.037466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe9812-7aac-4adb-a7ba-7d7a0229155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:12.038535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9812-7aac-4adb-a7ba-7d7a0229155d admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.038987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9812-7aac-4adb-a7ba-7d7a0229155d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.039448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9812-7aac-4adb-a7ba-7d7a0229155d admin admin] PATH_INFO: `/v3/projects/f7be6e4b788a488399a8309c89a12112/users/bb63c98502cd47a48a3793bb8913afd1/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.050753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:12.068554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f0017-9309-4197-b013-dd00bc0527a0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:12.074689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:12.075808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.076348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.076786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] PATH_INFO: `/v3/users/91e121d1065f4898af1e3ebbfbf84968` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.078133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e121d1065f4898af1e3ebbfbf84968)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:12.079962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe9812-7aac-4adb-a7ba-7d7a0229155d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7be6e4b788a488399a8309c89a12112, user_id=bb63c98502cd47a48a3793bb8913afd1, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:12.080788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:12.084660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe9812-7aac-4adb-a7ba-7d7a0229155d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:12.106448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1139/2279] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:12 2022] PUT /identity/v3/projects/f7be6e4b788a488399a8309c89a12112/users/bb63c98502cd47a48a3793bb8913afd1/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:40:12.118403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.118403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.118713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.168631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e121d1065f4898af1e3ebbfbf84968'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.186315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e121d1065f4898af1e3ebbfbf84968'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.187198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e121d1065f4898af1e3ebbfbf84968'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.187765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e121d1065f4898af1e3ebbfbf84968'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.197985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] MFA Rules not processed for user `bb63c98502cd47a48a3793bb8913afd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:12.199446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:12.210632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-749357b7-e053-4182-a8f0-02b0f808aae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e121d1065f4898af1e3ebbfbf84968'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.235493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1141/2280] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:12 2022] DELETE /identity/v3/users/91e121d1065f4898af1e3ebbfbf84968 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:12.237173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.237458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.237775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.271596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:12.272907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:12.289499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:12.337180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1140/2281] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:12.347677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:12.350022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:12.367200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1142/2282] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:12.376796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:12.379828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:12.433036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205bcd-ce58-4a19-8ca9-42ead119face None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:12.455455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284153-856b-4b16-8ba9-201fc0ac9917 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:12.459937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:12.461251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.461251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.461251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.472825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:12.474257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:12.502069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1143/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:40:12.509951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1059a-77ac-4d90-aae7-0abb5e4d6ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:12.510595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1059a-77ac-4d90-aae7-0abb5e4d6ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.510871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1059a-77ac-4d90-aae7-0abb5e4d6ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.511303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1059a-77ac-4d90-aae7-0abb5e4d6ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.564139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:12.595648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1059a-77ac-4d90-aae7-0abb5e4d6ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:12.598836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1059a-77ac-4d90-aae7-0abb5e4d6ad9 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:12.611065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1141/2284] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:12.765903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:12.767562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:12.790213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c4739-aaf8-427c-af64-2f99a54f1fc3 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:12.798110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:12.799456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.799456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.799456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] PATH_INFO: `/v3/projects/2b4c8a4daa9e4c26997e8f5bd1ec831a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.800913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4c8a4daa9e4c26997e8f5bd1ec831a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:12.804167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:12.867786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4c8a4daa9e4c26997e8f5bd1ec831a', 'request_id': 'req-171ed094-7ae8-4388-8c52-c5ebc2bb4660'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.875985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4c8a4daa9e4c26997e8f5bd1ec831a', 'request_id': 'req-171ed094-7ae8-4388-8c52-c5ebc2bb4660'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.886840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4c8a4daa9e4c26997e8f5bd1ec831a', 'request_id': 'req-171ed094-7ae8-4388-8c52-c5ebc2bb4660'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.898251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] The token cache is being invalidate because project 2b4c8a4daa9e4c26997e8f5bd1ec831a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:12.898842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.899710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-171ed094-7ae8-4388-8c52-c5ebc2bb4660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:12.901353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1144/2285] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:12 2022] DELETE /identity/v3/projects/2b4c8a4daa9e4c26997e8f5bd1ec831a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:12.907410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8ec1-5dfe-48ad-ac13-371af1011626 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:12.907727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8ec1-5dfe-48ad-ac13-371af1011626 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:12.908124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8ec1-5dfe-48ad-ac13-371af1011626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:12.934348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0dfe8ec1-5dfe-48ad-ac13-371af1011626 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:12.935605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0dfe8ec1-5dfe-48ad-ac13-371af1011626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:13.021839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1142/2286] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:13.027798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44edd2-6b91-428c-b809-4d5f60191f86 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.028074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44edd2-6b91-428c-b809-4d5f60191f86 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.028343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44edd2-6b91-428c-b809-4d5f60191f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.051929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8d44edd2-6b91-428c-b809-4d5f60191f86 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:13.053157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8d44edd2-6b91-428c-b809-4d5f60191f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:13.067345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1145/2287] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:13.068673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8ec1-5dfe-48ad-ac13-371af1011626 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.079126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8ec1-5dfe-48ad-ac13-371af1011626 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.085978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.087145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.087145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.087145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.087805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:13.088108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.089733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.102587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1143/2288] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:13.107999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44edd2-6b91-428c-b809-4d5f60191f86 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.117736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44edd2-6b91-428c-b809-4d5f60191f86 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.122758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.123448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.123797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.124132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.124846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.127026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.163262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1146/2289] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:13 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:40:13.164647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.176774 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15714ead-a4fa-4ce1-ab4b-52d05cfaba24 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.246172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.247208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.247588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.247955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.248739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.252553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.278961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1144/2290] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:13 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:13.284230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.297683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fca8a-5f03-44cf-ba64-2723e96e755a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.308561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.309410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.309694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.310030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.310759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.312704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.327178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1147/2291] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:13.331582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.342173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c2f1-5bd3-4842-815d-0ed890c3ce5d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.347602 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7788f5-271e-46da-af15-0d91df4f762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.348248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7788f5-271e-46da-af15-0d91df4f762a admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.348527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7788f5-271e-46da-af15-0d91df4f762a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.348809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7788f5-271e-46da-af15-0d91df4f762a admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.349928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7788f5-271e-46da-af15-0d91df4f762a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.351078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7788f5-271e-46da-af15-0d91df4f762a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.367021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.367462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1145/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:40:13.374649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:13.378616 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb4bc6-ea31-4fb9-8932-9aec5e5b959d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.384423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.385103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.385385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.385656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] PATH_INFO: `/v3/projects/a6a0bef5dc2e48f4b7dca32a9a54264f/users/78cecb18ae6e49868cc9b1e9d65fe697/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.404123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a0bef5dc2e48f4b7dca32a9a54264f, user_id=78cecb18ae6e49868cc9b1e9d65fe697, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.407311 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.422980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1148/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:13 2022] PUT /identity/v3/projects/a6a0bef5dc2e48f4b7dca32a9a54264f/users/78cecb18ae6e49868cc9b1e9d65fe697/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:13.487457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960799ca-f1de-4a6e-b675-be3d64acad56 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.488370 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960799ca-f1de-4a6e-b675-be3d64acad56 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.488758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960799ca-f1de-4a6e-b675-be3d64acad56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.518711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-960799ca-f1de-4a6e-b675-be3d64acad56 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:13.519626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-960799ca-f1de-4a6e-b675-be3d64acad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:13.587119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:13.641378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1146/2294] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:13.642093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.731685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2fc5-70aa-4f62-8bbd-996de7282ef4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.737827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.738477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.738759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.739099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.744103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.749997 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.826184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1149/2295] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:13 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:13.827139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960799ca-f1de-4a6e-b675-be3d64acad56 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.842855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960799ca-f1de-4a6e-b675-be3d64acad56 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:13.935338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:13.936237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:13.936570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:13.936952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:13.937644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:13.940011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:13.970996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1147/2296] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:13 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:40:13.974730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:13.988758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bacc51-8994-47e1-ab5f-1c2d5c2c9682 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:14.001907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:14.002888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:14.003474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:14.003961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:14.004970 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:14.007757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:14.025080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1150/2297] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:14.029758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:14.041348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4551a-6df4-4cfd-b865-b0a7b9a31c41 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:14.047704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:14.048410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:14.048937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:14.049342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] PATH_INFO: `/v3/projects/8c0a70a1e7304db4a8ec405fc04060d7/users/f99bb0d1674640f5bea24165fae25daf/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:14.067922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0a70a1e7304db4a8ec405fc04060d7, user_id=f99bb0d1674640f5bea24165fae25daf, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:14.071049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:14.091668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1148/2298] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:14 2022] PUT /identity/v3/projects/8c0a70a1e7304db4a8ec405fc04060d7/users/f99bb0d1674640f5bea24165fae25daf/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:14.095959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:14.109769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16bbb1-c430-4a66-9e30-40f361878d0b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:14.209538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293698c2-398f-4df8-ad8b-c208bef8c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:14.211728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293698c2-398f-4df8-ad8b-c208bef8c56f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:14.212218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293698c2-398f-4df8-ad8b-c208bef8c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:14.212662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293698c2-398f-4df8-ad8b-c208bef8c56f admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:14.218363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293698c2-398f-4df8-ad8b-c208bef8c56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:14.220505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293698c2-398f-4df8-ad8b-c208bef8c56f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:14.236889 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1151/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:14.240742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:14.252912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687621-f6d8-4c0b-9259-3bde7fb056a9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:14.258323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:14.260376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:14.260760 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:14.261226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] PATH_INFO: `/v3/projects/8c0a70a1e7304db4a8ec405fc04060d7/users/f99bb0d1674640f5bea24165fae25daf/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:14.264750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0a70a1e7304db4a8ec405fc04060d7, user_id=f99bb0d1674640f5bea24165fae25daf, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:14.268144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:14.281044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1149/2300] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:14 2022] PUT /identity/v3/projects/8c0a70a1e7304db4a8ec405fc04060d7/users/f99bb0d1674640f5bea24165fae25daf/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:40:14.291917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:14.292230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:14.292463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:14.326500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] MFA Rules not processed for user `f99bb0d1674640f5bea24165fae25daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:14.327528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:14.377673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:14.414725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1152/2301] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:14.436299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:14.438488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:14.543906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beec45-729d-4ce6-851d-18479371917c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:14.549088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:14.549913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:14.550201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:14.550471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:14.608929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:14.631636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:14.632966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:14.648682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1150/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:19.394253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:19.396598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:19.416931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64bb1c-6b78-4df4-a7b4-d3e564ad6d61 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:19.427500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f8218-3130-4114-9c8e-44b4629b5dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:19.428090 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8218-3130-4114-9c8e-44b4629b5dab service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:19.428377 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8218-3130-4114-9c8e-44b4629b5dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:19.428644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8218-3130-4114-9c8e-44b4629b5dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:19.456369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f8218-3130-4114-9c8e-44b4629b5dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:19.468873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f8218-3130-4114-9c8e-44b4629b5dab service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:19.496856 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1153/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:21.851154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:21.870506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbec50e-13af-4acc-b5d6-05a94652990d service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:21.876466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:21.877586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:21.878253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:21.878703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:21.881166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:21.961917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:21.964203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:22.000516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1151/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:29.486576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=17 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:29.584685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:29.585185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:29.585727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:29.610550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:29.611704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:29.631108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1154/2305] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:30.233840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:30.236246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:30.324236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555647d-baac-4a88-9e59-39ab5f24276a service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:30.331248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:30.332044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:30.332423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:30.332785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:30.334829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:30.348993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:30.350811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:30.363069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1152/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:30.638308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:30.639782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:30.654584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd3045-70f8-4dae-9c63-dc29063e03c1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:30.661559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:30.662236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:30.662710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:30.662983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] PATH_INFO: `/v3/users/b7de0ef4197c40b4b64dfc0339c19705` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:30.664639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7de0ef4197c40b4b64dfc0339c19705)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:30.666762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:30.725536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7de0ef4197c40b4b64dfc0339c19705'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:30.735334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7de0ef4197c40b4b64dfc0339c19705'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:30.736878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7de0ef4197c40b4b64dfc0339c19705'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:30.737459 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7de0ef4197c40b4b64dfc0339c19705'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:30.755743 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-39209be1-590a-4a9e-8d70-d12cdc99a3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7de0ef4197c40b4b64dfc0339c19705'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:30.774597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1155/2307] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:30 2022] DELETE /identity/v3/users/b7de0ef4197c40b4b64dfc0339c19705 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:40:31.525826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:31.559670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c59d-4c57-4024-bdb5-2a099478212f service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:31.684133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:31.700029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:31.702525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:31.703578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] PATH_INFO: `/v3/projects/3c3417a9665d4532bac3fe773e296c97` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:31.713612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3417a9665d4532bac3fe773e296c97)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:31.716545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:31.755643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:31.833068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3417a9665d4532bac3fe773e296c97', 'request_id': 'req-39023c12-511c-4261-90a9-5e51e521ff54'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:31.843637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3417a9665d4532bac3fe773e296c97', 'request_id': 'req-39023c12-511c-4261-90a9-5e51e521ff54'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:31.867801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3417a9665d4532bac3fe773e296c97', 'request_id': 'req-39023c12-511c-4261-90a9-5e51e521ff54'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:31.887682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] The token cache is being invalidate because project 3c3417a9665d4532bac3fe773e296c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:31.888006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:31.888710 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-39023c12-511c-4261-90a9-5e51e521ff54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:31.890558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1153/2308] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:31 2022] DELETE /identity/v3/projects/3c3417a9665d4532bac3fe773e296c97 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:31.895638 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a2ab-d34a-4ab1-9b42-2fcdf077ce83 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:31.896671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a2ab-d34a-4ab1-9b42-2fcdf077ce83 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:31.897218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a2ab-d34a-4ab1-9b42-2fcdf077ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:31.933543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-95a5a2ab-d34a-4ab1-9b42-2fcdf077ce83 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:31.935211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-95a5a2ab-d34a-4ab1-9b42-2fcdf077ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:32.051559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1156/2309] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:32.054403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a62b5-d006-400a-a55c-70d8f65efdc7 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.054868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a62b5-d006-400a-a55c-70d8f65efdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.055139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a62b5-d006-400a-a55c-70d8f65efdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.080343 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-3b0a62b5-d006-400a-a55c-70d8f65efdc7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:32.082098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3b0a62b5-d006-400a-a55c-70d8f65efdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:32.090152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1154/2310] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:32.094668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5a2ab-d34a-4ab1-9b42-2fcdf077ce83 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.105530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5a2ab-d34a-4ab1-9b42-2fcdf077ce83 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:32.110661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:32.111370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.112703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.113177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.113965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:32.114502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:32.116675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:32.132313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1157/2311] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:40:32.139007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a62b5-d006-400a-a55c-70d8f65efdc7 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.149980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a62b5-d006-400a-a55c-70d8f65efdc7 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:32.155808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:32.156530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.157410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.157410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.158074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:32.160092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:32.200169 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1155/2312] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:32 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:32.204521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.218345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497d98f-cf30-4c69-b416-634bfb627adb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:32.282739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:32.308054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:32.309441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.309957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.311199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.312025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:32.315697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:32.349018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1158/2313] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:32 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:40:32.354650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.368243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242ea6-fa46-4e97-b2f5-6b1511d9e473 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:32.373990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:32.376989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.377436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.377962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.378691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:32.380285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:32.406204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1156/2314] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:32.406828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.420367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492003c-dd0d-4578-a751-507afcc64a31 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:32.433235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39d222-2b93-48df-8189-f0c162a0bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:32.433893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39d222-2b93-48df-8189-f0c162a0bf0a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.434232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39d222-2b93-48df-8189-f0c162a0bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.434585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39d222-2b93-48df-8189-f0c162a0bf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.435523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39d222-2b93-48df-8189-f0c162a0bf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:32.437708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39d222-2b93-48df-8189-f0c162a0bf0a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:32.452340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1159/2315] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:32.458136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.480178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f4ad-71e3-4225-a5be-18cf25e76592 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:32.486020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:32.486696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.486969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.487234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] PATH_INFO: `/v3/projects/f8287f1677ae4edb871cef87f5b2904e/users/6cf31f9753e3490cad3ace8af47c195e/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.515419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8287f1677ae4edb871cef87f5b2904e, user_id=6cf31f9753e3490cad3ace8af47c195e, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:32.522011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:32.538550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1157/2316] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:32 2022] PUT /identity/v3/projects/f8287f1677ae4edb871cef87f5b2904e/users/6cf31f9753e3490cad3ace8af47c195e/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:32.549489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dfd49-e874-4dec-a3e9-5b2e56d1f7db None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.549768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dfd49-e874-4dec-a3e9-5b2e56d1f7db None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.550069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dfd49-e874-4dec-a3e9-5b2e56d1f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.599334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-443dfd49-e874-4dec-a3e9-5b2e56d1f7db None None] MFA Rules not processed for user `6cf31f9753e3490cad3ace8af47c195e`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:32.600361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-443dfd49-e874-4dec-a3e9-5b2e56d1f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:32.727618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.727857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1160/2317] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:32.828053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32261e-b7fa-4502-a0b1-7a9ea184ea7f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:32.833893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:32.834593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:32.834926 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:32.835251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:32.835950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:32.837929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:32.889678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1158/2318] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:32 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:32.893985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dfd49-e874-4dec-a3e9-5b2e56d1f7db None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:32.913091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dfd49-e874-4dec-a3e9-5b2e56d1f7db None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.038093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.038757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.039030 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.039295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.039929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.042293 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.069447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1161/2319] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:32 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:33.073109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.087525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e016-2539-4690-bc19-cf4c473a3ff9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.094984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.096717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.097216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.097701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.098658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.100989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.124264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1159/2320] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:33.128564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.141203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b366454-a435-4e86-acb1-4dfcb5bf761e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.152318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.153406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.154009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.154972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] PATH_INFO: `/v3/projects/c297aa6cf53642a0a478eb1a101a6344/users/8f384fd8f81f448a87acc4d54d8665d0/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.192817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c297aa6cf53642a0a478eb1a101a6344, user_id=8f384fd8f81f448a87acc4d54d8665d0, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.197181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.243509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.243878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1162/2321] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:33 2022] PUT /identity/v3/projects/c297aa6cf53642a0a478eb1a101a6344/users/8f384fd8f81f448a87acc4d54d8665d0/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:33.266075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7975dc8-b1c1-4b7e-a9bb-c26a93f444c1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.280210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:33.390765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de8dfb-f240-454d-9e69-a3e8d60edd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.391592 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8dfb-f240-454d-9e69-a3e8d60edd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.391867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8dfb-f240-454d-9e69-a3e8d60edd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.392145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8dfb-f240-454d-9e69-a3e8d60edd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.392812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de8dfb-f240-454d-9e69-a3e8d60edd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.394675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de8dfb-f240-454d-9e69-a3e8d60edd90 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.407273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1160/2322] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:40:33.411786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.423247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0379a2-39c0-43bf-b721-2567225cb43c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.428132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.428789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.429064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.429335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] PATH_INFO: `/v3/projects/c297aa6cf53642a0a478eb1a101a6344/users/8f384fd8f81f448a87acc4d54d8665d0/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.431429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c297aa6cf53642a0a478eb1a101a6344, user_id=8f384fd8f81f448a87acc4d54d8665d0, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.434098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.446480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1163/2323] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:33 2022] PUT /identity/v3/projects/c297aa6cf53642a0a478eb1a101a6344/users/8f384fd8f81f448a87acc4d54d8665d0/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:33.455916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f14d-2599-4f71-b442-ca6d159911cd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.456199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f14d-2599-4f71-b442-ca6d159911cd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.456470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f14d-2599-4f71-b442-ca6d159911cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.489850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-48d1f14d-2599-4f71-b442-ca6d159911cd None None] MFA Rules not processed for user `8f384fd8f81f448a87acc4d54d8665d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:33.490993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-48d1f14d-2599-4f71-b442-ca6d159911cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:33.589879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1161/2324] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:33.595046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.613022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba617-e6ba-4e8d-afad-6e62110e2935 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.633441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f384fd8f81f448a87acc4d54d8665d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c297aa6cf53642a0a478eb1a101a6344', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.634157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.634447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.634754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.636246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:33.636560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.638801 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.658448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:33.665137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1164/2325] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:40:33.670921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f14d-2599-4f71-b442-ca6d159911cd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.680671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f14d-2599-4f71-b442-ca6d159911cd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.686423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f384fd8f81f448a87acc4d54d8665d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c297aa6cf53642a0a478eb1a101a6344', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.688055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.688055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.688055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.688929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.690986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.767145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.773025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1162/2326] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:33 2022] POST /identity/v3/projects => generated 349 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:33.782497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306a6b5-0965-4214-a5fd-b7e3cd67cca2 tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.836302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.839874 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:33.919906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f384fd8f81f448a87acc4d54d8665d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c297aa6cf53642a0a478eb1a101a6344', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.920691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.920974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.921244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.921919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:33.922224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:33.923978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:33.957086 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1165/2327] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:33.957417 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a18df-a177-4a66-9a4a-8c45f78385ed tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.963577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.964298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.967373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:33.970086 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.970285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:33.979059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:33.979719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8cec2-7682-40f3-a0d7-a04a6d5f083a tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:33.994738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:33.995879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:33.996382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:33.996905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:34.024031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:34.025773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:34.044429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1166/2328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:34.045095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:34.107555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:34.109348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:34.126371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1163/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:34.297395 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:34.299932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:34.403224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b47b6-8d1a-4e17-b55f-4427e55facef service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:34.413714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:34.414651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:34.414959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:34.415332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:34.417943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:34.451778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:34.453535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:34.468481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1167/2330] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:36.757296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:36.758958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:36.777365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381644d-e7d1-4464-9eca-815e96df67b3 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:36.782111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:36.782953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:36.783381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:36.784204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:36.792492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:36.816209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:36.818085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:36.835825 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1164/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:38.273574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:38.288845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd86be-564d-4f11-985a-3ef0371ec251 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:38.303778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f384fd8f81f448a87acc4d54d8665d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c297aa6cf53642a0a478eb1a101a6344', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:38.304933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:38.305726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:38.306164 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] PATH_INFO: `/v3/projects/28fc4539bde64010832237132e69e3d9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:38.308201 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorizing `identity:delete_project(project_id=28fc4539bde64010832237132e69e3d9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:38.310206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:38.469141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28fc4539bde64010832237132e69e3d9', 'request_id': 'req-bf531985-f477-45bd-afee-b18fca3efb6f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.482836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28fc4539bde64010832237132e69e3d9', 'request_id': 'req-bf531985-f477-45bd-afee-b18fca3efb6f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.499894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28fc4539bde64010832237132e69e3d9', 'request_id': 'req-bf531985-f477-45bd-afee-b18fca3efb6f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.503787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:38.520656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] The token cache is being invalidate because project 28fc4539bde64010832237132e69e3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:38.520992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.524029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf531985-f477-45bd-afee-b18fca3efb6f tempest-QuotasNegativeTest-1020202157 tempest-QuotasNegativeTest-1020202157-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.531039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1168/2332] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:38 2022] DELETE /identity/v3/projects/28fc4539bde64010832237132e69e3d9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:38.536529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:38.633445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba9f2-717a-4feb-9e94-beaf51d91a7a service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:38.728572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:38.729561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:38.730146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:38.730639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] PATH_INFO: `/v3/users/6cf31f9753e3490cad3ace8af47c195e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:38.732110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf31f9753e3490cad3ace8af47c195e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:38.734380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:38.805659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:38.807146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf31f9753e3490cad3ace8af47c195e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.808642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf31f9753e3490cad3ace8af47c195e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.833165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf31f9753e3490cad3ace8af47c195e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.865219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf31f9753e3490cad3ace8af47c195e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.868215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf31f9753e3490cad3ace8af47c195e'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:38.925470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1165/2333] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:38 2022] DELETE /identity/v3/users/6cf31f9753e3490cad3ace8af47c195e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:38.927812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:38.928436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:38.928863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:38.958894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:38.960020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:39.060121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1169/2334] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:39.073969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:39.080214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:39.207057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1754da3-9e3b-45d3-890c-6e2bf650f701 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:39.215973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091085c-dfd1-44d7-a628-8f8ba885b1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:39.216876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091085c-dfd1-44d7-a628-8f8ba885b1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:39.217363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091085c-dfd1-44d7-a628-8f8ba885b1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:39.217888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091085c-dfd1-44d7-a628-8f8ba885b1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:39.244296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091085c-dfd1-44d7-a628-8f8ba885b1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:39.246265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091085c-dfd1-44d7-a628-8f8ba885b1a8 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:39.267172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1166/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:39.507017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:39.508510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:39.537456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58024b-dc3d-4814-ab15-7115fe77e700 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:39.551876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:39.552534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:39.552809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:39.553078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] PATH_INFO: `/v3/users/8350d290d0124d4cb892705cbbb66909` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:39.554715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8350d290d0124d4cb892705cbbb66909)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:39.557839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:39.675727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8350d290d0124d4cb892705cbbb66909'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:39.697836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8350d290d0124d4cb892705cbbb66909'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:39.698754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8350d290d0124d4cb892705cbbb66909'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:39.699244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8350d290d0124d4cb892705cbbb66909'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:39.715669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8350d290d0124d4cb892705cbbb66909'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:39.732721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1170/2336] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:39 2022] DELETE /identity/v3/users/8350d290d0124d4cb892705cbbb66909 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:39.738298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:39.738809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:39.738809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:39.765381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:39.767267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:39.859344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1167/2337] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:39.894498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:39.895945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:40.031472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f95e7d-11c6-4e1b-8179-c5993ca563d6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:40.036124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:40.036965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.037390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.037909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.054911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:40.058693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:40.080431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1171/2338] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:40.504517 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:40.505996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:40.507671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:40.509022 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:40.530556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93abb-4e61-4fbc-9146-a97db52b718b service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:40.539326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:40.540658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.541166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.541560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7041e-fb2a-4fd9-b885-0f740f614050 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:40.542091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] PATH_INFO: `/v3/projects/712c063a226945b2a16140520fcee12d` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.543955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=712c063a226945b2a16140520fcee12d)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:40.546127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:40.549361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:40.549516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:40.550201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.550516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.550854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] PATH_INFO: `/v3/projects/f8287f1677ae4edb871cef87f5b2904e` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.552383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8287f1677ae4edb871cef87f5b2904e)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:40.556069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:40.614594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712c063a226945b2a16140520fcee12d', 'request_id': 'req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.622069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712c063a226945b2a16140520fcee12d', 'request_id': 'req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.629211 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712c063a226945b2a16140520fcee12d', 'request_id': 'req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.635335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8287f1677ae4edb871cef87f5b2904e', 'request_id': 'req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.642158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8287f1677ae4edb871cef87f5b2904e', 'request_id': 'req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.645218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:40.648135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] The token cache is being invalidate because project 712c063a226945b2a16140520fcee12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:40.648491 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.649731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a3661f90-8cfc-4882-bac7-ac4f8620aa6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.656058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1172/2339] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:40 2022] DELETE /identity/v3/projects/712c063a226945b2a16140520fcee12d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:40.656236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8287f1677ae4edb871cef87f5b2904e', 'request_id': 'req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.658321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863ad9d-b0ed-4bf3-9c95-5e6ada1a4b20 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.658703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863ad9d-b0ed-4bf3-9c95-5e6ada1a4b20 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.659007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863ad9d-b0ed-4bf3-9c95-5e6ada1a4b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.669752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] The token cache is being invalidate because project f8287f1677ae4edb871cef87f5b2904e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:40.670978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.671263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.675751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1168/2340] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:40 2022] DELETE /identity/v3/projects/f8287f1677ae4edb871cef87f5b2904e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:40.677483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:40.679574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:40.682642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3863ad9d-b0ed-4bf3-9c95-5e6ada1a4b20 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:40.684188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3863ad9d-b0ed-4bf3-9c95-5e6ada1a4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:40.748849 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90b772-9c5b-4388-b4cf-6a3d649e7b46 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:40.754809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:40.755565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.756038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.756565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] PATH_INFO: `/v3/users/8f384fd8f81f448a87acc4d54d8665d0` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.757943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1173/2341] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:40.758136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f384fd8f81f448a87acc4d54d8665d0)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:40.760263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:40.763859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49671b-24e9-4083-b8d4-e4f9f1e2b6cc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.765186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49671b-24e9-4083-b8d4-e4f9f1e2b6cc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.765461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49671b-24e9-4083-b8d4-e4f9f1e2b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.786601 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8e49671b-24e9-4083-b8d4-e4f9f1e2b6cc None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:40.787806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8e49671b-24e9-4083-b8d4-e4f9f1e2b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:40.801908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1174/2342] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:40.806585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49671b-24e9-4083-b8d4-e4f9f1e2b6cc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:40.824073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49671b-24e9-4083-b8d4-e4f9f1e2b6cc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:40.834794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:40.835413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.835683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.835946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.836580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:40.836881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:40.838688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:40.840174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f384fd8f81f448a87acc4d54d8665d0'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.841256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f384fd8f81f448a87acc4d54d8665d0'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.856792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1175/2343] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:40:40.863463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:40.874244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f384fd8f81f448a87acc4d54d8665d0'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.884219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f1d-434d-4a4c-8708-a06ecdaacf0e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:40.888072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f384fd8f81f448a87acc4d54d8665d0'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.888869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f384fd8f81f448a87acc4d54d8665d0'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:40.894229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:40.894968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:40.895480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:40.895847 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:40.897840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:40.903774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:40.932776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1169/2344] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:40 2022] DELETE /identity/v3/users/8f384fd8f81f448a87acc4d54d8665d0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:40.956476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1176/2345] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:40 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:40.958001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:40.959921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:41.064959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb621-582a-4d66-be52-71892a6ff9bf admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.106242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:41.213224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.213224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.213551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.213826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.214384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.216331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.255656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1170/2346] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:40 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:41.257080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.281864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe723c0-3636-4a55-a252-8baff5f85e08 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.290809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.291509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.292427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.292791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.293454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.295643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.307462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1177/2347] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:41.311317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.322087 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892645a-60ff-4fa5-83ee-eac7eb002d9e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.326943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.327558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.327836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.328091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.328811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.330568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.343864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1171/2348] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:40:41.348462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.362314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786ca1-4b42-4d75-a183-61307c5b8fc6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.367408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88e3f6-c7b5-4432-a29c-726d0cfffac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.371308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88e3f6-c7b5-4432-a29c-726d0cfffac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.371462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.372984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88e3f6-c7b5-4432-a29c-726d0cfffac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.373255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:41.373695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88e3f6-c7b5-4432-a29c-726d0cfffac3 admin admin] PATH_INFO: `/v3/projects/0628b4e4b50645fcaffd83a840387f40/users/5f933c3da15e468b91faee142b4ce093/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.396109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e83b5-338f-4a2d-80fc-b937e6b68b34 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.399463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88e3f6-c7b5-4432-a29c-726d0cfffac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0628b4e4b50645fcaffd83a840387f40, user_id=5f933c3da15e468b91faee142b4ce093, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.403371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88e3f6-c7b5-4432-a29c-726d0cfffac3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.408413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.409208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.409538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.409865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] PATH_INFO: `/v3/projects/c297aa6cf53642a0a478eb1a101a6344` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.411560 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c297aa6cf53642a0a478eb1a101a6344)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.414368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.426474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1178/2349] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:41 2022] PUT /identity/v3/projects/0628b4e4b50645fcaffd83a840387f40/users/5f933c3da15e468b91faee142b4ce093/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:41.437616 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.438300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.438782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.471961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] MFA Rules not processed for user `5f933c3da15e468b91faee142b4ce093`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:41.473305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:41.476255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c297aa6cf53642a0a478eb1a101a6344', 'request_id': 'req-09f0298d-f2e4-47e3-9dde-9a882d68bb26'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:41.478247 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:41.484917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c297aa6cf53642a0a478eb1a101a6344', 'request_id': 'req-09f0298d-f2e4-47e3-9dde-9a882d68bb26'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:41.495316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c297aa6cf53642a0a478eb1a101a6344', 'request_id': 'req-09f0298d-f2e4-47e3-9dde-9a882d68bb26'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:41.508214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] The token cache is being invalidate because project c297aa6cf53642a0a478eb1a101a6344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:41.508214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:41.508921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-09f0298d-f2e4-47e3-9dde-9a882d68bb26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:41.510962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1172/2350] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:41 2022] DELETE /identity/v3/projects/c297aa6cf53642a0a478eb1a101a6344 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:40:41.515967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8ff49-c40f-4f14-b787-368409503807 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.516324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8ff49-c40f-4f14-b787-368409503807 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.516848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8ff49-c40f-4f14-b787-368409503807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.540384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b8f8ff49-c40f-4f14-b787-368409503807 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:41.541947 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b8f8ff49-c40f-4f14-b787-368409503807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:41.555320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1179/2351] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:41.566730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.568147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:41.610103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1173/2352] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:41.619397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ec50-7b03-40ba-bd1a-9a52b1b6fdab None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.619397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ec50-7b03-40ba-bd1a-9a52b1b6fdab None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.619397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ec50-7b03-40ba-bd1a-9a52b1b6fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.644383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e648ec50-7b03-40ba-bd1a-9a52b1b6fdab None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:41.645242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7b431-0b6d-42eb-88bc-1c24de80edb9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.645743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e648ec50-7b03-40ba-bd1a-9a52b1b6fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:41.650162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.650784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.651042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.651304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.655538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1174/2353] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:41.660881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648ec50-7b03-40ba-bd1a-9a52b1b6fdab None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.661879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.663341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.670631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648ec50-7b03-40ba-bd1a-9a52b1b6fdab None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.673358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1180/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:40:41.675909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.676590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.676927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.677258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.678001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:41.678431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.680255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.687927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:41.697735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1175/2355] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:40:41.698666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.710186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b8ef-5043-4a39-9a96-ce03f24309b0 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.715280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.715868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.716138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.716401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.717021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.719190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.749705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1181/2356] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:41 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:40:41.754531 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.765344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c4256-f7d9-4596-bc72-1e2a313c89f2 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.826308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.826933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.827544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.827544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.828125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.830999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.854423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1176/2357] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:41 2022] POST /identity/v3/users => generated 279 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:41.859220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.873534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866b1a-c59d-4a44-a0ee-99afff87caef admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.880558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.881179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.881456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.881721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.883220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.884850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.896639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1182/2358] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:41.902266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.914221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e3efb-a39e-4c9a-ae30-9a023198a2bd admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.919422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49049b14-d883-4415-820f-b4aac4a7b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.920095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049b14-d883-4415-820f-b4aac4a7b636 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.920366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049b14-d883-4415-820f-b4aac4a7b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.920630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049b14-d883-4415-820f-b4aac4a7b636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.921294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49049b14-d883-4415-820f-b4aac4a7b636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.922962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49049b14-d883-4415-820f-b4aac4a7b636 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.934578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1177/2359] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:41.939134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:41.950132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ecb5-4a65-4ce6-82dd-1ca63a0db703 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:41.955514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:41.956172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:41.956444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:41.956709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] PATH_INFO: `/v3/projects/4d42a9033aff4761b75453c6bf6da375/users/4b16984c952d445e93c13b6b10b25295/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:41.972392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d42a9033aff4761b75453c6bf6da375, user_id=4b16984c952d445e93c13b6b10b25295, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:41.975108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:41.991374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1183/2360] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:41 2022] PUT /identity/v3/projects/4d42a9033aff4761b75453c6bf6da375/users/4b16984c952d445e93c13b6b10b25295/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:42.001755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383557b-23e5-47d8-922d-b2765b794ade None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.002078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383557b-23e5-47d8-922d-b2765b794ade None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.002347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383557b-23e5-47d8-922d-b2765b794ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.031254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5383557b-23e5-47d8-922d-b2765b794ade None None] MFA Rules not processed for user `4b16984c952d445e93c13b6b10b25295`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:42.032605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5383557b-23e5-47d8-922d-b2765b794ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:42.105670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1178/2361] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:42.110543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.167144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:42.182421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257797f-dec2-4bfa-b9dc-f1c015884426 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.189896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.190846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.190846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.191039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.191809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.194567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.258223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1184/2362] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:42 2022] POST /identity/v3/projects => generated 355 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:42.261270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383557b-23e5-47d8-922d-b2765b794ade None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.273322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383557b-23e5-47d8-922d-b2765b794ade None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.340629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.341554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.341816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.342099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.342769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.345068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.360005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:42.375300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1179/2363] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:42 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:42.379526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.392302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca49696-cd3b-4258-9a22-ea710d7c1981 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.397657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.398411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.398754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.399093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.399810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.401572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.422217 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1185/2364] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:42.424664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.437361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaddf9e-f68d-4fa2-8bfa-11daf1fdbec3 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.443628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.444118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.444711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.445060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] PATH_INFO: `/v3/projects/1da0691725f947d2bf067bcdc3f43322/users/94ae5b161ece4fb883b175b2044b4c8e/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.463724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da0691725f947d2bf067bcdc3f43322, user_id=94ae5b161ece4fb883b175b2044b4c8e, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.466709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.487309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1180/2365] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:42 2022] PUT /identity/v3/projects/1da0691725f947d2bf067bcdc3f43322/users/94ae5b161ece4fb883b175b2044b4c8e/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:42.489227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.500020 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb66d0c-a425-439d-9253-8d533d8fc5a0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.574120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ef605-9593-4ed9-bcc4-3ee54f5ae6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.575141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef605-9593-4ed9-bcc4-3ee54f5ae6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.575631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef605-9593-4ed9-bcc4-3ee54f5ae6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.576319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef605-9593-4ed9-bcc4-3ee54f5ae6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.577402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ef605-9593-4ed9-bcc4-3ee54f5ae6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.580410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ef605-9593-4ed9-bcc4-3ee54f5ae6d4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.603406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1186/2366] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:42.611958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.624221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6d62-3266-406f-a89a-fe2c15090d72 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.631151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.632008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.632144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.632488 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] PATH_INFO: `/v3/projects/1da0691725f947d2bf067bcdc3f43322/users/94ae5b161ece4fb883b175b2044b4c8e/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.634891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da0691725f947d2bf067bcdc3f43322, user_id=94ae5b161ece4fb883b175b2044b4c8e, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.637608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.653403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1181/2367] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:42 2022] PUT /identity/v3/projects/1da0691725f947d2bf067bcdc3f43322/users/94ae5b161ece4fb883b175b2044b4c8e/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:42.664388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4200c-504b-4f32-a674-991ac72d5994 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.664676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4200c-504b-4f32-a674-991ac72d5994 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.665035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4200c-504b-4f32-a674-991ac72d5994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.707340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a9b4200c-504b-4f32-a674-991ac72d5994 None None] MFA Rules not processed for user `94ae5b161ece4fb883b175b2044b4c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:42.708969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a9b4200c-504b-4f32-a674-991ac72d5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:42.823796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.825788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1187/2368] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:42.839756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce6e8e-1e64-47a3-affc-b8a25f8094ca admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.854216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94ae5b161ece4fb883b175b2044b4c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da0691725f947d2bf067bcdc3f43322', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.855380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.855721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.856058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.856810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:42.857245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.859875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.882001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1182/2369] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:42.886200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4200c-504b-4f32-a674-991ac72d5994 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:42.907655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4200c-504b-4f32-a674-991ac72d5994 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:42.917857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94ae5b161ece4fb883b175b2044b4c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da0691725f947d2bf067bcdc3f43322', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:42.918809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:42.919325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:42.919839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:42.921550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:42.924195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:42.991917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1188/2370] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:42 2022] POST /identity/v3/projects => generated 348 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:42.996241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:43.009444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc432ba-1768-4902-86d1-055181991423 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:43.088691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94ae5b161ece4fb883b175b2044b4c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da0691725f947d2bf067bcdc3f43322', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:43.089314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:43.089597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:43.089881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:43.090575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:43.090884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:43.092978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:43.109528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1183/2371] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:43.143559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:43.145965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:43.177716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:43.212451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25200676-df45-4ac2-b4b5-d86e72fa1542 tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:43.217035 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:43.217834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:43.218133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:43.218439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:43.230737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:43.232193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:43.242752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1189/2372] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:43.668365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:43.680902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911505e9-33e4-4eec-885d-6e1a6b534bde tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:43.692746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94ae5b161ece4fb883b175b2044b4c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da0691725f947d2bf067bcdc3f43322', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:43.693424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:43.695449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:43.695727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] PATH_INFO: `/v3/projects/f93e2b9137e0463b95fbbbb1a0c24a05` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:43.698610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f93e2b9137e0463b95fbbbb1a0c24a05)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:43.700545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:43.759626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93e2b9137e0463b95fbbbb1a0c24a05', 'request_id': 'req-0aaec062-0b42-4995-9aa3-735c4fbab18f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:43.766149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93e2b9137e0463b95fbbbb1a0c24a05', 'request_id': 'req-0aaec062-0b42-4995-9aa3-735c4fbab18f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:43.777593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93e2b9137e0463b95fbbbb1a0c24a05', 'request_id': 'req-0aaec062-0b42-4995-9aa3-735c4fbab18f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:43.791236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] The token cache is being invalidate because project f93e2b9137e0463b95fbbbb1a0c24a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:43.791954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:43.792337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0aaec062-0b42-4995-9aa3-735c4fbab18f tempest-QuotasTest-985017384 tempest-QuotasTest-985017384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:43.794284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1184/2373] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:43 2022] DELETE /identity/v3/projects/f93e2b9137e0463b95fbbbb1a0c24a05 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:40:44.292359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:44.442077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46532cc-27d2-4975-a121-012b5e570d19 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:44.534837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:44.535810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:44.536713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:44.537613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] PATH_INFO: `/v3/users/4b16984c952d445e93c13b6b10b25295` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:44.539029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b16984c952d445e93c13b6b10b25295)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:44.543331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:44.600950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b16984c952d445e93c13b6b10b25295'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:44.628718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b16984c952d445e93c13b6b10b25295'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:44.630070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b16984c952d445e93c13b6b10b25295'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:44.630859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b16984c952d445e93c13b6b10b25295'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:44.646710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b16984c952d445e93c13b6b10b25295'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:44.653532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:44.670681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1190/2374] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:44 2022] DELETE /identity/v3/users/4b16984c952d445e93c13b6b10b25295 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:44.674751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:44.675283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:44.675283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:44.715218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:44.716466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:44.738126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:44.800803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1185/2375] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:44.832802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:44.834676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:44.923485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90d6f-3eb7-4bd9-b4da-e0f96bfc7d37 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:44.928306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:44.928851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:44.929224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:44.929659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:44.943481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:44.945381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:44.959241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1191/2376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:45.615043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:45.616565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:45.630772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c26337-5da6-4e2d-b772-fe92bfd94b19 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:45.645226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:45.649688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:45.650484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:45.651255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] PATH_INFO: `/v3/projects/4d42a9033aff4761b75453c6bf6da375` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:45.655244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d42a9033aff4761b75453c6bf6da375)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:45.660887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:45.732987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d42a9033aff4761b75453c6bf6da375', 'request_id': 'req-6c8e9c88-2a55-459b-83a4-ff4b4225df54'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.739576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d42a9033aff4761b75453c6bf6da375', 'request_id': 'req-6c8e9c88-2a55-459b-83a4-ff4b4225df54'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.750862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d42a9033aff4761b75453c6bf6da375', 'request_id': 'req-6c8e9c88-2a55-459b-83a4-ff4b4225df54'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.765440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] The token cache is being invalidate because project 4d42a9033aff4761b75453c6bf6da375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:45.766004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.766743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.768699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1186/2377] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:45 2022] DELETE /identity/v3/projects/4d42a9033aff4761b75453c6bf6da375 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:45.772513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:45.783328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0919-a638-48f7-a49e-43a613cc41dd service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:45.853321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:45.853990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:45.854265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:45.854534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] PATH_INFO: `/v3/users/94ae5b161ece4fb883b175b2044b4c8e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:45.855928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ae5b161ece4fb883b175b2044b4c8e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:45.857623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:45.952853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ae5b161ece4fb883b175b2044b4c8e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.968557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ae5b161ece4fb883b175b2044b4c8e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.969400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ae5b161ece4fb883b175b2044b4c8e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.970286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ae5b161ece4fb883b175b2044b4c8e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:45.985558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ae5b161ece4fb883b175b2044b4c8e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:46.008967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1192/2378] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:45 2022] DELETE /identity/v3/users/94ae5b161ece4fb883b175b2044b4c8e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:40:46.464057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:46.466459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:46.483509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e9c88-2a55-459b-83a4-ff4b4225df54 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:46.503231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:46.505014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:46.536443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:46.602991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:46.604274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:46.604608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:46.604929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] PATH_INFO: `/v3/projects/1da0691725f947d2bf067bcdc3f43322` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:46.607220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da0691725f947d2bf067bcdc3f43322)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:46.609228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:46.631907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aca17-5d1e-46a0-9266-aa82dd51ac07 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:46.636267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a9ed-70e6-4b32-99f0-6bf8fe1e5e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:46.637190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a9ed-70e6-4b32-99f0-6bf8fe1e5e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:46.637632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a9ed-70e6-4b32-99f0-6bf8fe1e5e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:46.638077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a9ed-70e6-4b32-99f0-6bf8fe1e5e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:46.640089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9852a9ed-70e6-4b32-99f0-6bf8fe1e5e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:46.659960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a9ed-70e6-4b32-99f0-6bf8fe1e5e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:46.662564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a9ed-70e6-4b32-99f0-6bf8fe1e5e0a service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:46.680466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1193/2379] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:40:46.697914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:46.704326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da0691725f947d2bf067bcdc3f43322', 'request_id': 'req-77f5b407-5f5d-49a7-8b60-b0372b684662'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:46.716441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da0691725f947d2bf067bcdc3f43322', 'request_id': 'req-77f5b407-5f5d-49a7-8b60-b0372b684662'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:46.732918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da0691725f947d2bf067bcdc3f43322', 'request_id': 'req-77f5b407-5f5d-49a7-8b60-b0372b684662'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:46.747686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] The token cache is being invalidate because project 1da0691725f947d2bf067bcdc3f43322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:46.748249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:46.748689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-77f5b407-5f5d-49a7-8b60-b0372b684662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:46.756424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1187/2380] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:46 2022] DELETE /identity/v3/projects/1da0691725f947d2bf067bcdc3f43322 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:46.757702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5fa18-fc8a-47ff-bf1a-f9043a358291 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:46.758017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5fa18-fc8a-47ff-bf1a-f9043a358291 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:46.758280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5fa18-fc8a-47ff-bf1a-f9043a358291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:46.798860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8ea5fa18-fc8a-47ff-bf1a-f9043a358291 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:46.802316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8ea5fa18-fc8a-47ff-bf1a-f9043a358291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:46.890043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1194/2381] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:40:46.897717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467a03-46cd-4388-bd74-998d4d10b441 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:46.898109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467a03-46cd-4388-bd74-998d4d10b441 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:46.898663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467a03-46cd-4388-bd74-998d4d10b441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:46.924674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-82467a03-46cd-4388-bd74-998d4d10b441 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:46.926477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-82467a03-46cd-4388-bd74-998d4d10b441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:46.939705 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5fa18-fc8a-47ff-bf1a-f9043a358291 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:46.940403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1188/2382] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:46.951747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5fa18-fc8a-47ff-bf1a-f9043a358291 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:46.958993 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:46.959879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:46.960341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:46.960826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:46.961871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:46.962369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:46.964561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:46.986078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1195/2383] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:46.987657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82467a03-46cd-4388-bd74-998d4d10b441 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:46.998682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82467a03-46cd-4388-bd74-998d4d10b441 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.005457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.006467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.006732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.007183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.007824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.009965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.060440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1189/2384] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:46 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:47.062289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.074385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb47666-7d98-4519-bef9-37c1e20fec97 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.145972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.146581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.146857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.147123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.147742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.149700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.180662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1196/2385] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:47 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:47.182214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.193900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c622fa-118c-4f90-848e-41454b69d482 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.199219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.200052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.200329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.200596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.201236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.202862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.214412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1190/2386] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:47.218992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.230978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa65c-faf1-465a-ae59-1cc2cee30adf admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.244075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544df6d-9829-4cae-8b75-8ca785fca912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.244689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544df6d-9829-4cae-8b75-8ca785fca912 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.244973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544df6d-9829-4cae-8b75-8ca785fca912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.245230 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544df6d-9829-4cae-8b75-8ca785fca912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.245900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544df6d-9829-4cae-8b75-8ca785fca912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.258500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544df6d-9829-4cae-8b75-8ca785fca912 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.272959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1197/2387] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:47.277267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.294348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f85c-b3bd-42ec-810b-7c390a821c38 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.303952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.305119 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.305534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.306169 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] PATH_INFO: `/v3/projects/046ca880a7da443e959de2e9052a45fd/users/72ae10d89b7c42b2a7e3b6a26fb7808d/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.326136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=046ca880a7da443e959de2e9052a45fd, user_id=72ae10d89b7c42b2a7e3b6a26fb7808d, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.329355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.345530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1191/2388] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:47 2022] PUT /identity/v3/projects/046ca880a7da443e959de2e9052a45fd/users/72ae10d89b7c42b2a7e3b6a26fb7808d/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:47.358036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ab4c-f231-4050-893b-fe6a1dc28f57 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.358900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ab4c-f231-4050-893b-fe6a1dc28f57 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.358900 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ab4c-f231-4050-893b-fe6a1dc28f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.392642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4f08ab4c-f231-4050-893b-fe6a1dc28f57 None None] MFA Rules not processed for user `72ae10d89b7c42b2a7e3b6a26fb7808d`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:47.393897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4f08ab4c-f231-4050-893b-fe6a1dc28f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:47.409065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:47.520439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1198/2389] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:47.525109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.607791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce42c81-e915-4672-b53f-5ae4caf6c86e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.623261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.623967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.624243 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.624513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.625309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.627905 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.665454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1192/2390] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:47 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:40:47.667466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ab4c-f231-4050-893b-fe6a1dc28f57 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.682244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ab4c-f231-4050-893b-fe6a1dc28f57 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.752566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.753127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.753409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.753675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.754511 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.756441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.804157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1199/2391] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:40:47 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:47.809348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.829613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50d7c-6556-477a-8ec3-3a36b6366fb8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.836508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.837388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.837728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.838116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.839021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.840842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.860662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1193/2392] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:47.874960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.892969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341ccc-2672-43f8-9001-210967bc4789 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.904331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.905038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.905304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.906077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] PATH_INFO: `/v3/projects/47f084844b634ec2990e01d6d1fb024f/users/1a9b92b28986496db9e60a898d457273/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.924515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f084844b634ec2990e01d6d1fb024f, user_id=1a9b92b28986496db9e60a898d457273, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.928087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.945523 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1200/2393] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:47 2022] PUT /identity/v3/projects/47f084844b634ec2990e01d6d1fb024f/users/1a9b92b28986496db9e60a898d457273/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:47.949493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.961287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0743a-f1a8-45d1-8304-d96a4045e9c6 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:48.035286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:48.073621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55d7bb-8dc9-40ff-a5b3-e5edc58ecfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:48.074438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d7bb-8dc9-40ff-a5b3-e5edc58ecfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:48.074776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d7bb-8dc9-40ff-a5b3-e5edc58ecfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:48.075130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d7bb-8dc9-40ff-a5b3-e5edc58ecfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:48.076537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55d7bb-8dc9-40ff-a5b3-e5edc58ecfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:48.081511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55d7bb-8dc9-40ff-a5b3-e5edc58ecfc1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:48.104005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1194/2394] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:40:48.106285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:48.123328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4d428-dffa-4ab5-aa40-d32df0ddc3bb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:48.139181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:48.139995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:48.140399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:48.140800 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] PATH_INFO: `/v3/projects/47f084844b634ec2990e01d6d1fb024f/users/1a9b92b28986496db9e60a898d457273/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:48.144606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f084844b634ec2990e01d6d1fb024f, user_id=1a9b92b28986496db9e60a898d457273, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:48.148084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:48.178986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1201/2395] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:40:48 2022] PUT /identity/v3/projects/47f084844b634ec2990e01d6d1fb024f/users/1a9b92b28986496db9e60a898d457273/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:48.185883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:48.186268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:48.186633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:48.226940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] MFA Rules not processed for user `1a9b92b28986496db9e60a898d457273`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:48.229173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:48.329570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1195/2396] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:48.344871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:48.347426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:48.453216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fba42c-ea00-4225-b76c-94c1d5a73834 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:48.461518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb82cd8-2590-4803-b9ab-6cd97760d584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:48.462614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb82cd8-2590-4803-b9ab-6cd97760d584 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:48.463708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb82cd8-2590-4803-b9ab-6cd97760d584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:48.464223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb82cd8-2590-4803-b9ab-6cd97760d584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:48.480043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb82cd8-2590-4803-b9ab-6cd97760d584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:48.482136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb82cd8-2590-4803-b9ab-6cd97760d584 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:48.495912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1202/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:51.225347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:51.226895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:51.319986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810dc47-74e4-4fa5-ac11-2b21b7c1eda3 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:51.327667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:51.328567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:51.328913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:51.329390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] PATH_INFO: `/v3/users/5f933c3da15e468b91faee142b4ce093` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:51.331050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f933c3da15e468b91faee142b4ce093)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:51.334476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:51.392324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f933c3da15e468b91faee142b4ce093'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:51.393080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f933c3da15e468b91faee142b4ce093'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:51.409660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f933c3da15e468b91faee142b4ce093'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:51.416209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:51.420286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f933c3da15e468b91faee142b4ce093'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:51.421731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f933c3da15e468b91faee142b4ce093'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:51.441582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1196/2398] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:40:51 2022] DELETE /identity/v3/users/5f933c3da15e468b91faee142b4ce093 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:51.446070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:51.446625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:51.446625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:51.478143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:51.479542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:51.486821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:51.570876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1203/2399] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:51.592755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:51.594688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:51.680824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248663c-4022-4551-85ee-92d91887c361 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:51.685147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:51.686413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:51.686910 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:51.687193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:51.698437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:51.700582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:51.711447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1197/2400] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:40:52.232366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:52.234340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:52.248180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae67f-7d65-4161-9187-f6b09322f3e8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:52.252918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:52.253581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:52.254343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:52.254343 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] PATH_INFO: `/v3/projects/0628b4e4b50645fcaffd83a840387f40` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:52.255342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0628b4e4b50645fcaffd83a840387f40)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:52.257426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:52.385895 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0628b4e4b50645fcaffd83a840387f40', 'request_id': 'req-789e143f-f76a-4fa4-bc8e-0dddfc7da788'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:52.400056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0628b4e4b50645fcaffd83a840387f40', 'request_id': 'req-789e143f-f76a-4fa4-bc8e-0dddfc7da788'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:52.410944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0628b4e4b50645fcaffd83a840387f40', 'request_id': 'req-789e143f-f76a-4fa4-bc8e-0dddfc7da788'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:52.436448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] The token cache is being invalidate because project 0628b4e4b50645fcaffd83a840387f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:52.436596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:52.437312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:52.457951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1204/2401] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:52 2022] DELETE /identity/v3/projects/0628b4e4b50645fcaffd83a840387f40 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:56.574357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:56.576130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:56.660386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9961-b0fd-46c6-8dcb-85ce152d14fb service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:56.722037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9b92b28986496db9e60a898d457273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f084844b634ec2990e01d6d1fb024f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:56.722664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:56.722949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:56.723229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:56.723863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:56.724168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:56.725881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:56.738411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1198/2402] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:40:56.742492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:56.744018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:56.760854 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e143f-f76a-4fa4-bc8e-0dddfc7da788 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:56.765651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9b92b28986496db9e60a898d457273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f084844b634ec2990e01d6d1fb024f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:56.766356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:56.766724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:56.767062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:56.767774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:56.769903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:56.799406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1205/2403] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:40:56 2022] POST /identity/v3/projects => generated 348 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:40:56.803881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:56.814014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef10aa-dd2d-4db3-ad82-fb05dd6d29fe tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:56.843619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:56.878697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9b92b28986496db9e60a898d457273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f084844b634ec2990e01d6d1fb024f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:56.879868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:56.880331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:56.880749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:56.881660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:40:56.882158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:56.883899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:56.905264 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1199/2404] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:57.380357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:57.391640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d844fe0-cc9a-40a5-a9a1-41ff5585a6d6 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:57.396570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a9b92b28986496db9e60a898d457273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f084844b634ec2990e01d6d1fb024f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:57.397299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:57.397683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:57.398001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] PATH_INFO: `/v3/projects/47cb7b5c25cf4d76a8bcf71a6aaea434` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:57.399332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorizing `identity:delete_project(project_id=47cb7b5c25cf4d76a8bcf71a6aaea434)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:57.401344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:57.455504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cb7b5c25cf4d76a8bcf71a6aaea434', 'request_id': 'req-a84a4931-48c9-4045-b08f-69b3a1d60481'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:57.461684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cb7b5c25cf4d76a8bcf71a6aaea434', 'request_id': 'req-a84a4931-48c9-4045-b08f-69b3a1d60481'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:57.467599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cb7b5c25cf4d76a8bcf71a6aaea434', 'request_id': 'req-a84a4931-48c9-4045-b08f-69b3a1d60481'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:57.470914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:57.483067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] The token cache is being invalidate because project 47cb7b5c25cf4d76a8bcf71a6aaea434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:40:57.483373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:57.484399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:40:57.486005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1206/2405] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:40:57 2022] DELETE /identity/v3/projects/47cb7b5c25cf4d76a8bcf71a6aaea434 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:40:57.496829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:57.498610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:57.565610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7798b-e2fb-4117-80ae-76b346f63e72 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:57.622812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df11c0-1ba4-4400-a6ed-779fecedc50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:57.624277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df11c0-1ba4-4400-a6ed-779fecedc50f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:57.624552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df11c0-1ba4-4400-a6ed-779fecedc50f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:57.624907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df11c0-1ba4-4400-a6ed-779fecedc50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:57.627257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-68df11c0-1ba4-4400-a6ed-779fecedc50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:57.690767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df11c0-1ba4-4400-a6ed-779fecedc50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:57.692287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df11c0-1ba4-4400-a6ed-779fecedc50f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:57.702180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1200/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:41:07.482367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:07.697688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=84 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:29.156772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:29.158295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:29.236958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a4931-48c9-4045-b08f-69b3a1d60481 tempest-RoutersAdminTest-1164744023 tempest-RoutersAdminTest-1164744023-project-admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:29.241981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:29.242634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:29.242910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:29.243181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] PATH_INFO: `/v3/users/72ae10d89b7c42b2a7e3b6a26fb7808d` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:29.244439 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ae10d89b7c42b2a7e3b6a26fb7808d)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:29.246513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:29.319162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ae10d89b7c42b2a7e3b6a26fb7808d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:29.329979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ae10d89b7c42b2a7e3b6a26fb7808d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:29.330735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ae10d89b7c42b2a7e3b6a26fb7808d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:29.331375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ae10d89b7c42b2a7e3b6a26fb7808d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:29.349716 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ae10d89b7c42b2a7e3b6a26fb7808d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:29.369316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1207/2407] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:41:29 2022] DELETE /identity/v3/users/72ae10d89b7c42b2a7e3b6a26fb7808d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:29.373562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:29.374095 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:29.374203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:29.395380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:29.396722 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:29.476527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1201/2408] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:29.486408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:29.487823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:29.548817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce86c3-9ea0-4772-9452-74678d51cf34 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:29.552659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:29.553381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:29.553820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:29.554100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:29.563738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:29.565177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:29.574687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1208/2409] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:30.018393 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:30.020218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:30.035823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c656245-db13-4d4a-abb7-03e1ee550271 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:30.040691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:30.041573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:30.042044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:30.042373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] PATH_INFO: `/v3/projects/046ca880a7da443e959de2e9052a45fd` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:30.043586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=046ca880a7da443e959de2e9052a45fd)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:30.045628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:30.097636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046ca880a7da443e959de2e9052a45fd', 'request_id': 'req-e7889c67-d091-4a82-9542-f159a9dd6b9b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.103568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046ca880a7da443e959de2e9052a45fd', 'request_id': 'req-e7889c67-d091-4a82-9542-f159a9dd6b9b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.113190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046ca880a7da443e959de2e9052a45fd', 'request_id': 'req-e7889c67-d091-4a82-9542-f159a9dd6b9b'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.124964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] The token cache is being invalidate because project 046ca880a7da443e959de2e9052a45fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:41:30.125247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.125903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.127399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1202/2410] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:41:30 2022] DELETE /identity/v3/projects/046ca880a7da443e959de2e9052a45fd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:30.131532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:30.141822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09a47-0201-43a3-93b3-4c489565209b service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:30.160965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:30.201159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:30.201911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:30.202183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:30.202432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] PATH_INFO: `/v3/users/1a9b92b28986496db9e60a898d457273` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:30.203600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9b92b28986496db9e60a898d457273)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:30.205542 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:30.257767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9b92b28986496db9e60a898d457273'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.265545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9b92b28986496db9e60a898d457273'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.266236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9b92b28986496db9e60a898d457273'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.266832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9b92b28986496db9e60a898d457273'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.278906 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74a5ddb7-49bf-4b2c-8525-4226eb42c5fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9b92b28986496db9e60a898d457273'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.296557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1209/2411] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:41:30 2022] DELETE /identity/v3/users/1a9b92b28986496db9e60a898d457273 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:30.480618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:30.482237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:30.501698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7889c67-d091-4a82-9542-f159a9dd6b9b admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:30.576067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:30.576721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:30.576990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:30.577740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] PATH_INFO: `/v3/projects/47f084844b634ec2990e01d6d1fb024f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:30.579547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f084844b634ec2990e01d6d1fb024f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:30.581485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:30.626009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:30.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f084844b634ec2990e01d6d1fb024f', 'request_id': 'req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.653603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f084844b634ec2990e01d6d1fb024f', 'request_id': 'req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.664734 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f084844b634ec2990e01d6d1fb024f', 'request_id': 'req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.678067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] The token cache is being invalidate because project 47f084844b634ec2990e01d6d1fb024f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:41:30.678607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.679441 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d33fbc9c-ee84-46d8-9ea6-b47eca79185a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:30.681324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1203/2412] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:41:30 2022] DELETE /identity/v3/projects/47f084844b634ec2990e01d6d1fb024f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:30.686290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fcddb-08fa-4897-b45f-42789844f2d7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:30.686690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fcddb-08fa-4897-b45f-42789844f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:30.687058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fcddb-08fa-4897-b45f-42789844f2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:30.710925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8e0fcddb-08fa-4897-b45f-42789844f2d7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:30.712326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8e0fcddb-08fa-4897-b45f-42789844f2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:30.786259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1210/2413] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:30.794601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e1f0-1f0c-431a-b63e-239b776ea51d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:30.794875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e1f0-1f0c-431a-b63e-239b776ea51d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:30.795204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1e1f0-1f0c-431a-b63e-239b776ea51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:30.817009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a5d1e1f0-1f0c-431a-b63e-239b776ea51d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:30.818578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a5d1e1f0-1f0c-431a-b63e-239b776ea51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:30.831206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1204/2414] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:30.832603 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fcddb-08fa-4897-b45f-42789844f2d7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:30.843497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fcddb-08fa-4897-b45f-42789844f2d7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:30.849135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:30.849755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:30.850054 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:30.850312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:30.850948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:41:30.851239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:30.852862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:30.866263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1211/2415] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:41:30.871058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1e1f0-1f0c-431a-b63e-239b776ea51d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:30.881636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1e1f0-1f0c-431a-b63e-239b776ea51d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:30.886925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:30.887552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:30.887821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:30.888082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:30.888721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:30.890817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:30.923673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1205/2416] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:41:30 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:41:30.925186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:30.949350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7729-e983-43fa-891f-60039af3c9df admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:30.984455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:31.023915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:31.024605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:31.024941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:31.025273 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:31.026321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:31.028415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:31.053033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1212/2417] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:41:30 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:41:31.057464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:31.068016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47373d7-bc29-4d09-a002-659bc2fecacd admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:31.076272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:31.077361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:31.077361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:31.077572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:31.078126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:31.079942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:31.094008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1206/2418] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:41:31.095316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:31.106781 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554f61-44ca-4fa4-a80c-95c3eaa58d39 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:31.112275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492beb80-db7f-4364-9c18-8a29f8b41368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:31.112880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492beb80-db7f-4364-9c18-8a29f8b41368 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:31.113154 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492beb80-db7f-4364-9c18-8a29f8b41368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:31.113417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492beb80-db7f-4364-9c18-8a29f8b41368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:31.114082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492beb80-db7f-4364-9c18-8a29f8b41368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:31.115720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492beb80-db7f-4364-9c18-8a29f8b41368 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:31.130933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1213/2419] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:41:31.140085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:31.150483 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a916e-78ec-443e-90a4-9099c3ae41fc admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:31.155562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:31.156388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:31.156668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:31.156934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] PATH_INFO: `/v3/projects/e3ca3c7b0a664baa979885f10c175665/users/3ce1274ac15f444a934372ff95ffc25e/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:31.171812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ca3c7b0a664baa979885f10c175665, user_id=3ce1274ac15f444a934372ff95ffc25e, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:31.174492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:31.190118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1207/2420] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:41:31 2022] PUT /identity/v3/projects/e3ca3c7b0a664baa979885f10c175665/users/3ce1274ac15f444a934372ff95ffc25e/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:31.200571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:31.201075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:31.201258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:31.237067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] MFA Rules not processed for user `3ce1274ac15f444a934372ff95ffc25e`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:31.238447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:31.312798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1214/2421] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:31.325671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:31.327984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:31.390140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eea85-bc90-46eb-921b-d888204974c6 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:31.396951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b86d4a-edb7-40b3-83b6-f79c04cbad5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:31.397661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b86d4a-edb7-40b3-83b6-f79c04cbad5c service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:31.398034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b86d4a-edb7-40b3-83b6-f79c04cbad5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:31.398705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b86d4a-edb7-40b3-83b6-f79c04cbad5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:31.409273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b86d4a-edb7-40b3-83b6-f79c04cbad5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:31.410530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b86d4a-edb7-40b3-83b6-f79c04cbad5c service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:31.421746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1208/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:35.499301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:35.504695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:35.608375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e40822-45c2-430f-99ca-e3ba038b4d1c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:35.614142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:35.615047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:35.615479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:35.616053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] PATH_INFO: `/v3/users/bb63c98502cd47a48a3793bb8913afd1` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:35.617416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb63c98502cd47a48a3793bb8913afd1)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:35.620013 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:35.688755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:35.694369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb63c98502cd47a48a3793bb8913afd1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:35.704513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb63c98502cd47a48a3793bb8913afd1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:35.705271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb63c98502cd47a48a3793bb8913afd1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:35.706238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb63c98502cd47a48a3793bb8913afd1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:35.722036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb63c98502cd47a48a3793bb8913afd1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:35.739056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1215/2423] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:41:35 2022] DELETE /identity/v3/users/bb63c98502cd47a48a3793bb8913afd1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:35.743691 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:35.744141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:35.744256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:35.768942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:35.770503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:35.827612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:35.843536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1209/2424] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:35.853662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:35.855319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:35.925400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c82b0-f2bb-419b-b7f1-824b1ff6b6e5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:35.932057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e48bf-52e3-43b4-86b1-1ab51e328ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:35.932798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e48bf-52e3-43b4-86b1-1ab51e328ffc service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:35.932942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e48bf-52e3-43b4-86b1-1ab51e328ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:35.933214 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e48bf-52e3-43b4-86b1-1ab51e328ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:35.948722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e48bf-52e3-43b4-86b1-1ab51e328ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:35.950683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e48bf-52e3-43b4-86b1-1ab51e328ffc service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:35.962582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1216/2425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:36.164571 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.166382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:36.188414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751112c4-3ea6-4ade-818d-96b7326587fd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:36.193943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:36.194701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.195068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.195426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] PATH_INFO: `/v3/projects/f7be6e4b788a488399a8309c89a12112` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.197588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7be6e4b788a488399a8309c89a12112)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:36.199847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:36.256334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7be6e4b788a488399a8309c89a12112', 'request_id': 'req-ba15cc4b-81d1-4179-95c3-da68216fd8b7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:36.264518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7be6e4b788a488399a8309c89a12112', 'request_id': 'req-ba15cc4b-81d1-4179-95c3-da68216fd8b7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:36.275285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7be6e4b788a488399a8309c89a12112', 'request_id': 'req-ba15cc4b-81d1-4179-95c3-da68216fd8b7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:36.289598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] The token cache is being invalidate because project f7be6e4b788a488399a8309c89a12112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:41:36.289968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:36.290581 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ba15cc4b-81d1-4179-95c3-da68216fd8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:36.296019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1210/2426] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:41:36 2022] DELETE /identity/v3/projects/f7be6e4b788a488399a8309c89a12112 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:36.297773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8993d5-fdc9-49dc-a013-ee5271a5e081 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.298174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8993d5-fdc9-49dc-a013-ee5271a5e081 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.298553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8993d5-fdc9-49dc-a013-ee5271a5e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.321647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8a8993d5-fdc9-49dc-a013-ee5271a5e081 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:36.322930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8a8993d5-fdc9-49dc-a013-ee5271a5e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:36.405427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1217/2427] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:36.413911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a012d-a780-4c38-9caf-fdec3b76c26a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.414392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a012d-a780-4c38-9caf-fdec3b76c26a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.414816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a012d-a780-4c38-9caf-fdec3b76c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.436457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ab7a012d-a780-4c38-9caf-fdec3b76c26a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:36.437768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ab7a012d-a780-4c38-9caf-fdec3b76c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:36.446142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1211/2428] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:36.450640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8993d5-fdc9-49dc-a013-ee5271a5e081 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.461532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8993d5-fdc9-49dc-a013-ee5271a5e081 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:36.467232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:36.467865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.468143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.468645 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.469581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:41:36.469581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:36.471328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:36.484462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1218/2429] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:41:36.488989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a012d-a780-4c38-9caf-fdec3b76c26a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.498919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a012d-a780-4c38-9caf-fdec3b76c26a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:36.504366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:36.504995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.505254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.505516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.506216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:36.508205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:36.539421 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1212/2430] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:41:36 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:41:36.543294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.554472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1473-b97e-4260-a1b5-7b5be3184564 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:36.607835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:36.628049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:36.628686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.628951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.629213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.629879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:36.631805 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:36.653907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1219/2431] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:41:36 2022] POST /identity/v3/users => generated 280 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:41:36.658516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.669685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94bfe8-dc6c-4ed7-a4b4-000e92add800 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:36.675582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:36.676290 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.676657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.676986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.677683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:36.679363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:36.693054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1213/2432] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:41:36.694372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.705995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a808e-5f20-4fa6-bf39-bfc9c4208bb2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:36.710987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9e838-353b-439e-8cd4-cf7865d9c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:36.711578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9e838-353b-439e-8cd4-cf7865d9c0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.711905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9e838-353b-439e-8cd4-cf7865d9c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.712169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9e838-353b-439e-8cd4-cf7865d9c0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.712818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9e838-353b-439e-8cd4-cf7865d9c0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:36.714474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9e838-353b-439e-8cd4-cf7865d9c0e5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:36.726605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1220/2433] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:41:36.731549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.744659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3c79-f600-4ad9-bd24-78595ba7c6fe admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:36.750688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:36.751693 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.753207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.753941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] PATH_INFO: `/v3/projects/4aeb122e7065445abe06982580478a31/users/8be350a1c03446ff827b0d672163b8dc/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.774413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aeb122e7065445abe06982580478a31, user_id=8be350a1c03446ff827b0d672163b8dc, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:36.777706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:36.798442 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1214/2434] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:41:36 2022] PUT /identity/v3/projects/4aeb122e7065445abe06982580478a31/users/8be350a1c03446ff827b0d672163b8dc/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:36.809435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:36.809709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:36.810031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:36.841429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] MFA Rules not processed for user `8be350a1c03446ff827b0d672163b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:36.843111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:36.913915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1221/2435] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:36.924497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:36.926909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:37.005445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146d4a-db55-463c-b024-5b55f2954720 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:37.009141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3513938-ed70-4c3e-beec-6b325c1f14b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:37.010039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3513938-ed70-4c3e-beec-6b325c1f14b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:37.010039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3513938-ed70-4c3e-beec-6b325c1f14b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:37.010532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3513938-ed70-4c3e-beec-6b325c1f14b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:37.020110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3513938-ed70-4c3e-beec-6b325c1f14b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:37.021778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3513938-ed70-4c3e-beec-6b325c1f14b7 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:37.032656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1215/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:37.417050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:37.419476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:37.505099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ae66-0065-4809-9e74-02317e766623 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:37.509741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:37.510437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:37.510848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:37.511116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] PATH_INFO: `/v3/users/3ce1274ac15f444a934372ff95ffc25e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:37.512244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce1274ac15f444a934372ff95ffc25e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:37.514428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:37.566866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce1274ac15f444a934372ff95ffc25e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:37.575137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce1274ac15f444a934372ff95ffc25e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:37.575838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce1274ac15f444a934372ff95ffc25e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:37.576556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce1274ac15f444a934372ff95ffc25e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:37.577728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:37.589883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce1274ac15f444a934372ff95ffc25e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:37.608380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1222/2437] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:41:37 2022] DELETE /identity/v3/users/3ce1274ac15f444a934372ff95ffc25e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:37.610876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:37.611262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:37.611593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:37.636872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:37.638114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:37.653633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:37.710746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1216/2438] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:37.722402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:37.724251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:37.787760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331b3b-7d33-4894-8a13-93a3c38bfa70 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:37.792451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0caaa8-6f48-4556-bcdb-01092bbfb6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:37.793093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0caaa8-6f48-4556-bcdb-01092bbfb6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:37.793369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0caaa8-6f48-4556-bcdb-01092bbfb6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:37.793633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0caaa8-6f48-4556-bcdb-01092bbfb6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:37.804838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0caaa8-6f48-4556-bcdb-01092bbfb6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:37.806386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0caaa8-6f48-4556-bcdb-01092bbfb6d3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:37.817270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1223/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:37.995831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:37.997584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:38.010431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49140a3a-7d82-4a07-8eb0-59ebee4a1d0f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.015914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.016422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.016788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.017090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] PATH_INFO: `/v3/projects/e3ca3c7b0a664baa979885f10c175665` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.018367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ca3c7b0a664baa979885f10c175665)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.020305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.072938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ca3c7b0a664baa979885f10c175665', 'request_id': 'req-a7a51731-4caa-440b-a093-8aa7f8571701'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:38.079862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ca3c7b0a664baa979885f10c175665', 'request_id': 'req-a7a51731-4caa-440b-a093-8aa7f8571701'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:38.092368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ca3c7b0a664baa979885f10c175665', 'request_id': 'req-a7a51731-4caa-440b-a093-8aa7f8571701'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:38.105106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] The token cache is being invalidate because project e3ca3c7b0a664baa979885f10c175665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:41:38.105472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:38.106194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a7a51731-4caa-440b-a093-8aa7f8571701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:38.107787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1217/2440] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:41:37 2022] DELETE /identity/v3/projects/e3ca3c7b0a664baa979885f10c175665 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:41:38.112594 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35465-0216-4d60-9602-460a92d2e7cb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.112973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35465-0216-4d60-9602-460a92d2e7cb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.113301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf35465-0216-4d60-9602-460a92d2e7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.136986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8cf35465-0216-4d60-9602-460a92d2e7cb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:38.138362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8cf35465-0216-4d60-9602-460a92d2e7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:38.215602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1224/2441] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:41:38.218273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928764b-1d2f-48fc-92b3-654c2bce2d3c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.218660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928764b-1d2f-48fc-92b3-654c2bce2d3c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.219985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928764b-1d2f-48fc-92b3-654c2bce2d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.242432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-9928764b-1d2f-48fc-92b3-654c2bce2d3c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:38.243803 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9928764b-1d2f-48fc-92b3-654c2bce2d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:38.252219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1218/2442] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:38.258358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf35465-0216-4d60-9602-460a92d2e7cb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:38.270347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf35465-0216-4d60-9602-460a92d2e7cb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.275931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.276749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.277261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.277548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.278500 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:41:38.278797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.280658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.300008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1225/2443] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:41:38.301003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928764b-1d2f-48fc-92b3-654c2bce2d3c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:38.312029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928764b-1d2f-48fc-92b3-654c2bce2d3c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.317130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.317963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.318238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.318496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.319297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.321234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.357154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1219/2444] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:41:38 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:41:38.361625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:38.372241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a874e6-0543-478a-9ad1-571d229093b7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.434399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.435133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.435364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.435720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.436419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.438506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.449610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:38.469864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1226/2445] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:41:38 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:41:38.474253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:38.487552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584b538-3531-4201-8a52-8a259ba8efd8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.493044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.493952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.494224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.494493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.495130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.496789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.508464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1220/2446] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:41:38.512210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:38.525108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5526081-35fe-4919-b1d2-6d0072d57568 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.531961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb393827-3e3f-4cea-b9e1-00b4363861b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.532760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb393827-3e3f-4cea-b9e1-00b4363861b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.536300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb393827-3e3f-4cea-b9e1-00b4363861b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.536598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb393827-3e3f-4cea-b9e1-00b4363861b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.537451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb393827-3e3f-4cea-b9e1-00b4363861b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.539593 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb393827-3e3f-4cea-b9e1-00b4363861b8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.552149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1227/2447] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:41:38.556757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:38.569006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e7f66-58f8-4c00-bb55-b717f34c88a2 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.576223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.576900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.577173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.577453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] PATH_INFO: `/v3/projects/9563cb82b9414ad68e770ecbd5992335/users/f46aaa8600de44599a09979e6f6316a8/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.595451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9563cb82b9414ad68e770ecbd5992335, user_id=f46aaa8600de44599a09979e6f6316a8, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.599615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.622215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1221/2448] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:41:38 2022] PUT /identity/v3/projects/9563cb82b9414ad68e770ecbd5992335/users/f46aaa8600de44599a09979e6f6316a8/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:38.635799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49fc41-0715-4001-83a4-aa4868ce681f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.636559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49fc41-0715-4001-83a4-aa4868ce681f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.636971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49fc41-0715-4001-83a4-aa4868ce681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.679813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cf49fc41-0715-4001-83a4-aa4868ce681f None None] MFA Rules not processed for user `f46aaa8600de44599a09979e6f6316a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:38.681222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf49fc41-0715-4001-83a4-aa4868ce681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:38.758028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1228/2449] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:38.769426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:38.771373 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:38.816195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:38.837775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe421036-93b2-4485-b5fa-f8bb2b1cd597 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:38.841529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac41f2-d3f5-4cc7-88b1-3428273d3f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:38.842268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac41f2-d3f5-4cc7-88b1-3428273d3f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:38.842540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac41f2-d3f5-4cc7-88b1-3428273d3f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:38.842805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac41f2-d3f5-4cc7-88b1-3428273d3f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:38.852257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac41f2-d3f5-4cc7-88b1-3428273d3f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:38.853714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac41f2-d3f5-4cc7-88b1-3428273d3f3e service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:38.865301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1222/2450] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:48.754766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:48.860349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=10 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:49.250973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49fc41-0715-4001-83a4-aa4868ce681f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:49.346476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49fc41-0715-4001-83a4-aa4868ce681f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:49.370435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:49.371180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:49.371985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:49.372540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] PATH_INFO: `/v3/users/f46aaa8600de44599a09979e6f6316a8` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:49.375399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46aaa8600de44599a09979e6f6316a8)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:49.377383 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:49.432975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46aaa8600de44599a09979e6f6316a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:49.440036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46aaa8600de44599a09979e6f6316a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:49.440946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46aaa8600de44599a09979e6f6316a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:49.441708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46aaa8600de44599a09979e6f6316a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:49.453621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46aaa8600de44599a09979e6f6316a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:49.477038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1229/2451] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:41:49 2022] DELETE /identity/v3/users/f46aaa8600de44599a09979e6f6316a8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:49.481928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:49.482345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:49.482622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:49.501743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:49.503080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:49.562912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1223/2452] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:49.573116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:49.574978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:49.637199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85b385-763c-4629-9f7e-f82abf27c0e5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:49.641875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145d0b4-1d37-4d1e-8db7-0b21feb99002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:49.642486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d0b4-1d37-4d1e-8db7-0b21feb99002 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:49.642780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d0b4-1d37-4d1e-8db7-0b21feb99002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:49.643051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d0b4-1d37-4d1e-8db7-0b21feb99002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:49.654401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145d0b4-1d37-4d1e-8db7-0b21feb99002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:49.656088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145d0b4-1d37-4d1e-8db7-0b21feb99002 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:49.668183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1230/2453] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:49.887895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:49.890123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:49.907662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fea516-1b89-42e0-bd2a-84c561185183 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:49.926692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:49.927814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:49.928352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:49.928787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] PATH_INFO: `/v3/projects/9563cb82b9414ad68e770ecbd5992335` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:49.930347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9563cb82b9414ad68e770ecbd5992335)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:49.932186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:49.991636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9563cb82b9414ad68e770ecbd5992335', 'request_id': 'req-f4ac2104-de51-4643-ba32-009c6c41a8a7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:50.001574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9563cb82b9414ad68e770ecbd5992335', 'request_id': 'req-f4ac2104-de51-4643-ba32-009c6c41a8a7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:50.011227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9563cb82b9414ad68e770ecbd5992335', 'request_id': 'req-f4ac2104-de51-4643-ba32-009c6c41a8a7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:50.027842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] The token cache is being invalidate because project 9563cb82b9414ad68e770ecbd5992335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:41:50.027842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:50.028575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f4ac2104-de51-4643-ba32-009c6c41a8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:41:50.033553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1224/2454] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:41:49 2022] DELETE /identity/v3/projects/9563cb82b9414ad68e770ecbd5992335 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:50.035442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3cb5-3d2c-4b96-a7c2-19ebec0c0b91 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.036060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3cb5-3d2c-4b96-a7c2-19ebec0c0b91 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.036060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3cb5-3d2c-4b96-a7c2-19ebec0c0b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.057180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4bbc3cb5-3d2c-4b96-a7c2-19ebec0c0b91 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:50.058507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4bbc3cb5-3d2c-4b96-a7c2-19ebec0c0b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:50.076142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:50.129390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1231/2455] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:41:50.137383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c884586-6e7e-49d6-a355-f86cf02f6dfb None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.137759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c884586-6e7e-49d6-a355-f86cf02f6dfb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.138278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c884586-6e7e-49d6-a355-f86cf02f6dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.161061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1c884586-6e7e-49d6-a355-f86cf02f6dfb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:50.162353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1c884586-6e7e-49d6-a355-f86cf02f6dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:50.171163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1225/2456] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:50.175672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3cb5-3d2c-4b96-a7c2-19ebec0c0b91 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:50.186330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3cb5-3d2c-4b96-a7c2-19ebec0c0b91 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:50.192416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:50.193148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.193541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.193775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.194477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:41:50.194821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:50.196634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:50.210202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1232/2457] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:41:50.214568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c884586-6e7e-49d6-a355-f86cf02f6dfb None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:50.224587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c884586-6e7e-49d6-a355-f86cf02f6dfb None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:50.229204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:50.229826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.230106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.230378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.230998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:50.233084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:50.263446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1226/2458] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:41:50 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:41:50.267818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:50.279114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60cd8-cf43-4efa-9238-816a976ab947 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:50.339835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:50.340444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.340710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.341027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.341850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:50.344190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:50.372078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1233/2459] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:41:50 2022] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:41:50.376883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:50.388566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ceffc-6c9e-40a5-8005-9cdfddeb66ed admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:50.395154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:50.395982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.396319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.396652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.397376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:50.399154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:50.413850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1227/2460] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:41:50.415633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:50.426700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde7378-ebd6-4031-9714-6c8dd045ca18 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:50.432238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9449fa-0ac5-4849-bad1-cc6a2ff97b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:50.433486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9449fa-0ac5-4849-bad1-cc6a2ff97b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.433486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9449fa-0ac5-4849-bad1-cc6a2ff97b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.433486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9449fa-0ac5-4849-bad1-cc6a2ff97b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.434182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9449fa-0ac5-4849-bad1-cc6a2ff97b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:50.435881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9449fa-0ac5-4849-bad1-cc6a2ff97b78 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:50.447349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1234/2461] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:41:50.452096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:50.462986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af98739-d6a2-4cdf-8c9a-f13ec0222d0e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:50.469301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:50.470005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.470274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.470539 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] PATH_INFO: `/v3/projects/6620aa1a0f1c435084f574feaa96f2ed/users/bcc1b8fe3e054b99bf5e1ad80b55fd60/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.486460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6620aa1a0f1c435084f574feaa96f2ed, user_id=bcc1b8fe3e054b99bf5e1ad80b55fd60, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:50.489208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:50.507301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1228/2462] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:41:50 2022] PUT /identity/v3/projects/6620aa1a0f1c435084f574feaa96f2ed/users/bcc1b8fe3e054b99bf5e1ad80b55fd60/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:41:50.517607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.517977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.518241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.548880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] MFA Rules not processed for user `bcc1b8fe3e054b99bf5e1ad80b55fd60`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:50.550130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:50.633106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1235/2463] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:41:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:50.643868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:50.646301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:50.671559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:50.715872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb493f08-2536-4473-b2c4-458f658288d8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:50.720170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:50.720780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:50.721050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:50.721314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:50.730587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:50.732391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:50.743079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1229/2464] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:41:54.869546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:54.871133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:54.909830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:55.071737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006efdd1-27a3-449e-9e04-1d74af4962ea None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:55.079290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:55.079960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:55.080233 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:55.080497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:55.082899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:55.105512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:55.109977 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:55.150026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1236/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:57.605432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:41:57.607309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:57.635189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab0d92-8b50-4ae3-b717-e32e16c65107 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:41:57.641875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1c735-2056-4058-8e4f-ee1803144ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:41:57.642520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c735-2056-4058-8e4f-ee1803144ad7 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:57.642881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c735-2056-4058-8e4f-ee1803144ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:57.643143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c735-2056-4058-8e4f-ee1803144ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:57.645220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1af1c735-2056-4058-8e4f-ee1803144ad7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:57.658615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1c735-2056-4058-8e4f-ee1803144ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:41:57.660305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1c735-2056-4058-8e4f-ee1803144ad7 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:41:57.672863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1230/2466] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:41:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:01.555802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:01.692213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106674de-28a4-4918-bfb2-2a3709bc271f service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:01.697101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:01.697915 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:01.698287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:01.698649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] PATH_INFO: `/v3/users/bcc1b8fe3e054b99bf5e1ad80b55fd60` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:01.700056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc1b8fe3e054b99bf5e1ad80b55fd60)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:01.702348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:01.800366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc1b8fe3e054b99bf5e1ad80b55fd60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:01.816462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc1b8fe3e054b99bf5e1ad80b55fd60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:01.817506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc1b8fe3e054b99bf5e1ad80b55fd60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:01.818304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc1b8fe3e054b99bf5e1ad80b55fd60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:01.833384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc1b8fe3e054b99bf5e1ad80b55fd60'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:01.876244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1237/2467] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:01 2022] DELETE /identity/v3/users/bcc1b8fe3e054b99bf5e1ad80b55fd60 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:01.881646 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:01.882564 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:01.883056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:01.907988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:01.909940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:02.015875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1231/2468] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:02.037669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:02.039229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:02.088298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:02.132618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b516-e025-4036-8e74-07e77b215af8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:02.138064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:02.139288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:02.139569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:02.139839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:02.155472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:02.157227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:02.169305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1238/2469] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:02.616453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:02.628514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:02.648151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e0f2-4ae4-464f-811c-0e5ac0b1c4fb None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:02.658888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:02.659758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:02.660045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:02.660369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] PATH_INFO: `/v3/projects/6620aa1a0f1c435084f574feaa96f2ed` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:02.662108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] RBAC: Authorizing `identity:delete_project(project_id=6620aa1a0f1c435084f574feaa96f2ed)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:02.664220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:02.752576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6620aa1a0f1c435084f574feaa96f2ed', 'request_id': 'req-817f6a4c-4271-4117-bf92-5af48033face'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:02.761150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6620aa1a0f1c435084f574feaa96f2ed', 'request_id': 'req-817f6a4c-4271-4117-bf92-5af48033face'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:02.774573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6620aa1a0f1c435084f574feaa96f2ed', 'request_id': 'req-817f6a4c-4271-4117-bf92-5af48033face'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:02.787332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] The token cache is being invalidate because project 6620aa1a0f1c435084f574feaa96f2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:02.787615 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:02.788269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-817f6a4c-4271-4117-bf92-5af48033face admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:02.790213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1232/2470] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:02 2022] DELETE /identity/v3/projects/6620aa1a0f1c435084f574feaa96f2ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:04.326991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:04.329237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:04.345914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e96fa-3e4d-4a03-a2fd-1021c3a6aa03 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:04.418197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:04.418948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:04.419277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:04.419611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] PATH_INFO: `/v3/users/9e838d815c93442c9ee043e4021598b5` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:04.420752 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e838d815c93442c9ee043e4021598b5)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:04.422774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:04.479130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e838d815c93442c9ee043e4021598b5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:04.486571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e838d815c93442c9ee043e4021598b5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:04.487270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e838d815c93442c9ee043e4021598b5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:04.487883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e838d815c93442c9ee043e4021598b5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:04.500153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e838d815c93442c9ee043e4021598b5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:04.514639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1239/2471] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:04 2022] DELETE /identity/v3/users/9e838d815c93442c9ee043e4021598b5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:04.519241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:04.519753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:04.519753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:04.539812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:04.541055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:04.572852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:04.627492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1233/2472] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:04.639236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:04.641376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:04.696607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:04.708728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae53ad-3f1a-48d9-9b41-d9c81abfae23 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:04.714414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:04.715901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:04.716515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:04.717002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:04.729751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:04.731843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:04.744021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1240/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:05.098988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:05.100732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:05.117366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53acfd-2c10-47a1-8635-00d9a6bf4d2c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:05.124553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:05.125399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:05.125779 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:05.126172 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] PATH_INFO: `/v3/projects/1ee0d00573b64145b3d8f51c323dc44f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:05.127472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee0d00573b64145b3d8f51c323dc44f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:05.129576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:05.201943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee0d00573b64145b3d8f51c323dc44f', 'request_id': 'req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.209746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee0d00573b64145b3d8f51c323dc44f', 'request_id': 'req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.227412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee0d00573b64145b3d8f51c323dc44f', 'request_id': 'req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.245981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] The token cache is being invalidate because project 1ee0d00573b64145b3d8f51c323dc44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:05.246794 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.247771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.249880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1234/2474] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:05 2022] DELETE /identity/v3/projects/1ee0d00573b64145b3d8f51c323dc44f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:05.254043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:05.286002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d90dc-339e-4033-a0f4-49e0090dd1f2 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:05.356360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:05.357222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:05.357498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:05.357762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] PATH_INFO: `/v3/users/d5471e3b47734eaeb06fb7e66423ce92` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:05.358939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5471e3b47734eaeb06fb7e66423ce92)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:05.361236 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:05.413486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5471e3b47734eaeb06fb7e66423ce92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.423621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5471e3b47734eaeb06fb7e66423ce92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.424634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5471e3b47734eaeb06fb7e66423ce92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.425609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5471e3b47734eaeb06fb7e66423ce92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.439029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-10233c81-4328-46b8-b052-07f60ba73eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5471e3b47734eaeb06fb7e66423ce92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:05.452614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1241/2475] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:05 2022] DELETE /identity/v3/users/d5471e3b47734eaeb06fb7e66423ce92 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:05.922642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:05.924354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:05.950771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecf0d9-5d39-48e9-b01b-01c40b2716d7 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.048461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.049106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.049376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.049630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] PATH_INFO: `/v3/projects/aa4af37c0e054384ae95a8aa214c2cc7` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.050824 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4af37c0e054384ae95a8aa214c2cc7)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.053007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.114360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4af37c0e054384ae95a8aa214c2cc7', 'request_id': 'req-3085ed60-e770-4566-ae75-87fc061022d3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:06.119979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4af37c0e054384ae95a8aa214c2cc7', 'request_id': 'req-3085ed60-e770-4566-ae75-87fc061022d3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:06.121675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:06.132205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4af37c0e054384ae95a8aa214c2cc7', 'request_id': 'req-3085ed60-e770-4566-ae75-87fc061022d3'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:06.145860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] The token cache is being invalidate because project aa4af37c0e054384ae95a8aa214c2cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:06.146146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:06.146768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3085ed60-e770-4566-ae75-87fc061022d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:06.153476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1235/2476] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:05 2022] DELETE /identity/v3/projects/aa4af37c0e054384ae95a8aa214c2cc7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:06.156242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3e70-4d13-4e09-ad3b-412cdd3ceb82 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.156548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3e70-4d13-4e09-ad3b-412cdd3ceb82 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.156822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3e70-4d13-4e09-ad3b-412cdd3ceb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.179619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c30d3e70-4d13-4e09-ad3b-412cdd3ceb82 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:06.181048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c30d3e70-4d13-4e09-ad3b-412cdd3ceb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:06.243837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1242/2477] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:06.253430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd14da9-5cf9-4ce4-88a1-58c466c79d12 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.253914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd14da9-5cf9-4ce4-88a1-58c466c79d12 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.254198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd14da9-5cf9-4ce4-88a1-58c466c79d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.277081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-8cd14da9-5cf9-4ce4-88a1-58c466c79d12 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:06.278453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8cd14da9-5cf9-4ce4-88a1-58c466c79d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:06.288242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1236/2478] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:06.296218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d3e70-4d13-4e09-ad3b-412cdd3ceb82 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:06.307042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d3e70-4d13-4e09-ad3b-412cdd3ceb82 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.311995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.312611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.312883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.313153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.313787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:06.314120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.315740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.317562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:06.330803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1243/2479] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:06.335195 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd14da9-5cf9-4ce4-88a1-58c466c79d12 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:06.345042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd14da9-5cf9-4ce4-88a1-58c466c79d12 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.365170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.365950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.366212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.366496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.367146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.369418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.400578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1237/2480] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:06 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:42:06.404595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:06.415564 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129195e-6191-41ce-be96-92d0cf5ab03f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.473603 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.474344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.474691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.474964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.475605 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.477554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.501155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1244/2481] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:06 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:42:06.506538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:06.518310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5019b97-9ea5-4177-9fd2-ba65ef37d9a7 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.524310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.524907 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.525536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.525837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.526506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.528293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.539837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1238/2482] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:06.544445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:06.555962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939021-5a37-47f5-a9d4-c388758604a5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.562502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ae3ad-9f7a-44a0-9d13-271923e80722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.563275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ae3ad-9f7a-44a0-9d13-271923e80722 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.563707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ae3ad-9f7a-44a0-9d13-271923e80722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.563978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ae3ad-9f7a-44a0-9d13-271923e80722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.564606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ae3ad-9f7a-44a0-9d13-271923e80722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.566257 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ae3ad-9f7a-44a0-9d13-271923e80722 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.579554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1245/2483] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:42:06.584200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:06.595953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ad18b-bc87-4361-ba36-5fcd8d92be88 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.601893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.602577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.602844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.603108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] PATH_INFO: `/v3/projects/6330b461a69f4f9e814355fa4bc12217/users/8ad6c68446944326b348ab5d35d69ed3/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.621585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6330b461a69f4f9e814355fa4bc12217, user_id=8ad6c68446944326b348ab5d35d69ed3, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.624711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.640127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1239/2484] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:06 2022] PUT /identity/v3/projects/6330b461a69f4f9e814355fa4bc12217/users/8ad6c68446944326b348ab5d35d69ed3/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:06.646174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e729e1-5e0c-47bd-9f7b-1b8d6b87d701 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.646450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e729e1-5e0c-47bd-9f7b-1b8d6b87d701 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.646713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e729e1-5e0c-47bd-9f7b-1b8d6b87d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.667774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-55e729e1-5e0c-47bd-9f7b-1b8d6b87d701 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:06.669088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-55e729e1-5e0c-47bd-9f7b-1b8d6b87d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:06.735973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1246/2485] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:06.745957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:06.748005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:06.808214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbf602-c226-4197-9019-9ca44a77dd91 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:06.812277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:06.812901 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:06.813168 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:06.813424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:06.823429 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:06.824892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:06.835426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1240/2486] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:07.511982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb294e-0749-496e-b8a4-91353dd9846e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:07.512912 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb294e-0749-496e-b8a4-91353dd9846e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:07.513189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb294e-0749-496e-b8a4-91353dd9846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:07.544696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fdbb294e-0749-496e-b8a4-91353dd9846e None None] MFA Rules not processed for user `8ad6c68446944326b348ab5d35d69ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:07.546141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fdbb294e-0749-496e-b8a4-91353dd9846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:07.624867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1247/2487] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:07.629145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:07.641477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a50d1-4049-4566-88f0-93ec57842bed service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:07.647558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:07.647895 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:07.648228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:07.648623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:07.649312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:07.651689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:07.691460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1241/2488] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:07 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:07.697921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb294e-0749-496e-b8a4-91353dd9846e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:07.704956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:07.719574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb294e-0749-496e-b8a4-91353dd9846e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:07.780964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:07.781571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:07.781888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:07.782156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:07.782787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:07.784931 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:07.807143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1248/2489] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:07 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:07.811791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:07.822210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cfca9-ba48-4e18-a939-44cbb08edb9e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:07.827372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:07.828101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:07.828388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:07.831822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:07.831822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:07.831822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:07.845481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1242/2490] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:07.846897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:07.857074 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033691-46a2-4413-a4e2-539c7ac3c9dc admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:07.862315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:07.862533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:07.862794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:07.863117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] PATH_INFO: `/v3/projects/bcab8e0970604cad9ca6220448259bb8/users/e6e67cf94736454bab3134a755e571b1/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:07.878771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcab8e0970604cad9ca6220448259bb8, user_id=e6e67cf94736454bab3134a755e571b1, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:07.881692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:07.897249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1249/2491] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:07 2022] PUT /identity/v3/projects/bcab8e0970604cad9ca6220448259bb8/users/e6e67cf94736454bab3134a755e571b1/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:07.901911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:07.912432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759730-fecc-4832-8230-a7678ceae26f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:07.963972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:07.972303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971be9f-3be3-4434-9fa4-1458c4acd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:07.972963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971be9f-3be3-4434-9fa4-1458c4acd468 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:07.973244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971be9f-3be3-4434-9fa4-1458c4acd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:07.973519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971be9f-3be3-4434-9fa4-1458c4acd468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:07.974400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971be9f-3be3-4434-9fa4-1458c4acd468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:07.976209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971be9f-3be3-4434-9fa4-1458c4acd468 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:07.988106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1243/2492] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:07.992338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:08.003126 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80fc57-61bd-4039-9a25-c3b1b4ca6ddb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:08.008324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a47c-e142-4937-b947-3e2b5867ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:08.008983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a47c-e142-4937-b947-3e2b5867ec8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:08.009259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a47c-e142-4937-b947-3e2b5867ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:08.009644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a47c-e142-4937-b947-3e2b5867ec8b admin admin] PATH_INFO: `/v3/projects/bcab8e0970604cad9ca6220448259bb8/users/e6e67cf94736454bab3134a755e571b1/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:08.011609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457a47c-e142-4937-b947-3e2b5867ec8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcab8e0970604cad9ca6220448259bb8, user_id=e6e67cf94736454bab3134a755e571b1, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:08.014492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457a47c-e142-4937-b947-3e2b5867ec8b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:08.025259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1250/2493] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:07 2022] PUT /identity/v3/projects/bcab8e0970604cad9ca6220448259bb8/users/e6e67cf94736454bab3134a755e571b1/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:09.366110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:09.366667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:09.366887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:09.406120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] MFA Rules not processed for user `e6e67cf94736454bab3134a755e571b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:09.407659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:09.497080 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1244/2494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:09.507478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae809d3-e371-4483-a751-5868b9bdac3f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:09.508464 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae809d3-e371-4483-a751-5868b9bdac3f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:09.508902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae809d3-e371-4483-a751-5868b9bdac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:09.569936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2ae809d3-e371-4483-a751-5868b9bdac3f None None] MFA Rules not processed for user `8ad6c68446944326b348ab5d35d69ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:09.572388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2ae809d3-e371-4483-a751-5868b9bdac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:09.702173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1251/2495] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:42:09.714626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:09.717160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:09.863366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f391eba-cbf5-4173-89c7-f42cc7887814 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:09.876358 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5e8ae-dfd2-4227-8656-7c91ac55b679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:09.879009 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5e8ae-dfd2-4227-8656-7c91ac55b679 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:09.879463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5e8ae-dfd2-4227-8656-7c91ac55b679 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:09.880039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5e8ae-dfd2-4227-8656-7c91ac55b679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:09.902201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5e8ae-dfd2-4227-8656-7c91ac55b679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:09.904948 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5e8ae-dfd2-4227-8656-7c91ac55b679 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:09.917092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1245/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:10.444443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae809d3-e371-4483-a751-5868b9bdac3f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:10.542522 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae809d3-e371-4483-a751-5868b9bdac3f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:10.559553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:10.561749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:10.562416 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:10.562867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:10.566245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:10.591592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:10.593548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:10.605440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1252/2497] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:11.110324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f639-f895-4e2c-b6bf-dd076ea07ce9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:11.117308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f639-f895-4e2c-b6bf-dd076ea07ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:11.117765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f639-f895-4e2c-b6bf-dd076ea07ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:11.147008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6759f639-f895-4e2c-b6bf-dd076ea07ce9 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:11.148749 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6759f639-f895-4e2c-b6bf-dd076ea07ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:11.229765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1246/2498] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:12.231785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:12.234112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:12.239454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:12.340683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9e50-28cb-49a0-bef8-7a9db02000e8 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:12.347379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:12.348391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:12.348862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:12.349347 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:12.351495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:12.368337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:12.370356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:12.384062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1253/2499] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:21.220201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:22.378179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=31 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:23.554696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f639-f895-4e2c-b6bf-dd076ea07ce9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.571992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f639-f895-4e2c-b6bf-dd076ea07ce9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.580105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.581100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.581594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.582152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.584884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.599856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.601617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.626626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1247/2500] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:33.613931 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:43.648848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:43.719738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9c382-9480-4db2-b037-f8462f4e940a service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:43.725095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:43.725874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:43.726145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:43.726411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] PATH_INFO: `/v3/users/8ad6c68446944326b348ab5d35d69ed3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:43.727534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad6c68446944326b348ab5d35d69ed3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:43.729611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:43.785450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad6c68446944326b348ab5d35d69ed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.792975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad6c68446944326b348ab5d35d69ed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.793655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad6c68446944326b348ab5d35d69ed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.794288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad6c68446944326b348ab5d35d69ed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.806372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad6c68446944326b348ab5d35d69ed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.819513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1254/2501] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:43 2022] DELETE /identity/v3/users/8ad6c68446944326b348ab5d35d69ed3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:44.046822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:44.062046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc5b9-d8d9-4dfc-b7f7-c6095e3b82cf service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:44.131419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:44.132187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.132467 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.132737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] PATH_INFO: `/v3/projects/6330b461a69f4f9e814355fa4bc12217` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.134134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6330b461a69f4f9e814355fa4bc12217)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:44.136254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:44.205458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6330b461a69f4f9e814355fa4bc12217', 'request_id': 'req-0177b620-5eba-4ab4-a252-47c873266f5d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.211744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6330b461a69f4f9e814355fa4bc12217', 'request_id': 'req-0177b620-5eba-4ab4-a252-47c873266f5d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.222154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6330b461a69f4f9e814355fa4bc12217', 'request_id': 'req-0177b620-5eba-4ab4-a252-47c873266f5d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.237065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] The token cache is being invalidate because project 6330b461a69f4f9e814355fa4bc12217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:44.237389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.238016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.239772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1248/2502] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:44 2022] DELETE /identity/v3/projects/6330b461a69f4f9e814355fa4bc12217 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:44.243573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:44.245531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:44.263324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02944ce9-e280-4dea-8ead-a2f67d249055 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:44.332260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:44.334658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.334948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.335235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] PATH_INFO: `/v3/users/e6e67cf94736454bab3134a755e571b1` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.336602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e67cf94736454bab3134a755e571b1)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:44.338496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:44.367428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:44.416649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e67cf94736454bab3134a755e571b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.438456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e67cf94736454bab3134a755e571b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.439339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e67cf94736454bab3134a755e571b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.439999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e67cf94736454bab3134a755e571b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.463346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0a207dfc-0ff6-4280-82e7-80d4398e7df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e67cf94736454bab3134a755e571b1'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.483042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1255/2503] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:44 2022] DELETE /identity/v3/users/e6e67cf94736454bab3134a755e571b1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:44.682348 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:44.683930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:44.703148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177b620-5eba-4ab4-a252-47c873266f5d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:44.772497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:44.773177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.773450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.773718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] PATH_INFO: `/v3/projects/bcab8e0970604cad9ca6220448259bb8` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.775391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcab8e0970604cad9ca6220448259bb8)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:44.777757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:44.817726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:44.837561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcab8e0970604cad9ca6220448259bb8', 'request_id': 'req-25088798-581c-4aee-b40d-6d5f020ffa63'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.843979 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcab8e0970604cad9ca6220448259bb8', 'request_id': 'req-25088798-581c-4aee-b40d-6d5f020ffa63'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.852953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcab8e0970604cad9ca6220448259bb8', 'request_id': 'req-25088798-581c-4aee-b40d-6d5f020ffa63'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.865093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] The token cache is being invalidate because project bcab8e0970604cad9ca6220448259bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:44.865454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.866219 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25088798-581c-4aee-b40d-6d5f020ffa63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.867766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1249/2504] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:44 2022] DELETE /identity/v3/projects/bcab8e0970604cad9ca6220448259bb8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:44.873182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b6734-24f1-4673-8215-71f7f20c5325 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.873742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b6734-24f1-4673-8215-71f7f20c5325 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.873742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b6734-24f1-4673-8215-71f7f20c5325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.894139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4a9b6734-24f1-4673-8215-71f7f20c5325 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:44.895462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4a9b6734-24f1-4673-8215-71f7f20c5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:44.955995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1256/2505] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:44.964034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5d81-32bf-451d-b1cd-bbc87eda3244 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.964395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5d81-32bf-451d-b1cd-bbc87eda3244 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.964761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5d81-32bf-451d-b1cd-bbc87eda3244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.986650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5ead5d81-32bf-451d-b1cd-bbc87eda3244 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:44.987760 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5ead5d81-32bf-451d-b1cd-bbc87eda3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:44.996928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1250/2506] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:45.001328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b6734-24f1-4673-8215-71f7f20c5325 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.011853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b6734-24f1-4673-8215-71f7f20c5325 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.018057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.018690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.018963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.019299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.020324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:45.021024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.022338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.056481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead5d81-32bf-451d-b1cd-bbc87eda3244 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.063033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1257/2507] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:45.070211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead5d81-32bf-451d-b1cd-bbc87eda3244 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.082687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.083333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.083609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.083877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.084520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.091365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.143887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1251/2508] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:45 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:42:45.148133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.174300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3c0d-343f-4e26-8d59-445abbde714a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.246323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.246935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.247264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.247538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.248171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.250147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.272514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1258/2509] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:45 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:45.277608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.292940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a29569-b570-48b8-b6d2-8ac36b7c3511 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.298603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.299327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.299601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.299867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.300505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.302275 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.313271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1252/2510] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:45.317123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.327325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728ae37-a5cd-47b0-a96d-92440aafa88a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.332053 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5677d-b479-4aa3-9638-fbc10f7cd38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.332651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5677d-b479-4aa3-9638-fbc10f7cd38b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.332922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5677d-b479-4aa3-9638-fbc10f7cd38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.333185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5677d-b479-4aa3-9638-fbc10f7cd38b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.333818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5677d-b479-4aa3-9638-fbc10f7cd38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.335434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5677d-b479-4aa3-9638-fbc10f7cd38b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.346859 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1259/2511] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:45.351307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.361618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7830aa7-9131-472a-89c2-6d750e1be6e3 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.366857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.367513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.367778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.368040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] PATH_INFO: `/v3/projects/3db30626cbec44e19871e9ca61fd785b/users/c0a8c6c7a9184df8bb471c0f68813a0f/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.382971 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db30626cbec44e19871e9ca61fd785b, user_id=c0a8c6c7a9184df8bb471c0f68813a0f, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.385701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.400679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1253/2512] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:45 2022] PUT /identity/v3/projects/3db30626cbec44e19871e9ca61fd785b/users/c0a8c6c7a9184df8bb471c0f68813a0f/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:45.406101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6e5f7-1602-4be3-a97a-e1b08c2146b5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.406376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6e5f7-1602-4be3-a97a-e1b08c2146b5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.406695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6e5f7-1602-4be3-a97a-e1b08c2146b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.416241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:45.431669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-28c6e5f7-1602-4be3-a97a-e1b08c2146b5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:45.433490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-28c6e5f7-1602-4be3-a97a-e1b08c2146b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:45.493392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1260/2513] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:45.503410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.505308 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:45.567274 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59ac49-438d-43ee-895f-9aa7cc1474d9 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.571030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.571661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.571934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.572200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.582504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.583962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.594830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1254/2514] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:51.690381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.691010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.691010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.725284 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] MFA Rules not processed for user `c0a8c6c7a9184df8bb471c0f68813a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:51.726553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:51.800366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1261/2515] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:51.805222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:51.815297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088b0c-7341-4f9e-a921-acd752c177c3 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:51.819880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:51.820506 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.820778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.821201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.821842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:51.823822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:51.831255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:51.832754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:51.847385 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47c96-a56f-4362-9ae3-d947d76d9e6f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:51.852223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:51.852922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.853259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.853613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] PATH_INFO: `/v3/users/8be350a1c03446ff827b0d672163b8dc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.854574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1255/2516] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:51 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:51.855437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be350a1c03446ff827b0d672163b8dc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:51.855577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:51.857514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:51.908969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:51.910518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be350a1c03446ff827b0d672163b8dc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:51.920910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be350a1c03446ff827b0d672163b8dc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:51.921626 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be350a1c03446ff827b0d672163b8dc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:51.922299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be350a1c03446ff827b0d672163b8dc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:51.932930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e7acf-1828-4298-a3aa-96b42258cda8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:51.934688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8f36de6f-031c-4068-8a41-ab448bdf79b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be350a1c03446ff827b0d672163b8dc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:51.937818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:51.938440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.938721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.939173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.939639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:51.941723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:51.949307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1262/2517] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:51 2022] DELETE /identity/v3/users/8be350a1c03446ff827b0d672163b8dc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:51.954341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.954648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.954919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.968133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1256/2518] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:51 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:51.968962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:51.969655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:51.971494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:51.977006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:51.978629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:51.986433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a19de-2225-497c-82fe-642cf57a3d9e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.053407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1263/2519] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:52.056218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.057082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.057229 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.058076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.058726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.060519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.063941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:52.065357 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:52.074584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1257/2520] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:42:52.078958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:52.089249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d7b2-203b-46f1-a346-eb793e898f69 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.093767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.094912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.095071 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.095260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] PATH_INFO: `/v3/projects/cc902c29069d451b83463b45d772e2d2/users/a4c2be72467a46f4a2f5fb66f66c4ede/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.110063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc902c29069d451b83463b45d772e2d2, user_id=a4c2be72467a46f4a2f5fb66f66c4ede, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.112811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.126454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89397-13a2-4d97-b057-111d6069b619 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.132090 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1258/2521] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:52 2022] PUT /identity/v3/projects/cc902c29069d451b83463b45d772e2d2/users/a4c2be72467a46f4a2f5fb66f66c4ede/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:52.133284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:52.189609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0447f-e8f0-49b7-a474-5f16dcd67c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.190562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0447f-e8f0-49b7-a474-5f16dcd67c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.190562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0447f-e8f0-49b7-a474-5f16dcd67c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.190848 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0447f-e8f0-49b7-a474-5f16dcd67c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.205594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8c135-2751-4ae7-be76-b18de91ce50e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.210619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.211355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.211690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.212012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.212737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.214639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.224990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1259/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:52.229225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:52.239054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bbb8a-ce7c-4e4b-ad6c-9959b93ee695 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.243626 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.244234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.244712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.244882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] PATH_INFO: `/v3/projects/cc902c29069d451b83463b45d772e2d2/users/a4c2be72467a46f4a2f5fb66f66c4ede/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.247188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc902c29069d451b83463b45d772e2d2, user_id=a4c2be72467a46f4a2f5fb66f66c4ede, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.249809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.258846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0447f-e8f0-49b7-a474-5f16dcd67c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.260408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0447f-e8f0-49b7-a474-5f16dcd67c50 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.262049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1260/2523] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:52 2022] PUT /identity/v3/projects/cc902c29069d451b83463b45d772e2d2/users/a4c2be72467a46f4a2f5fb66f66c4ede/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:52.271674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1264/2524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:52.496600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:52.499289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:52.538270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:52.599208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678db6f-6aeb-489e-acb2-46d6de14c365 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.606030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.606806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.607170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.607568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] PATH_INFO: `/v3/projects/4aeb122e7065445abe06982580478a31` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.608942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aeb122e7065445abe06982580478a31)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.611138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.686083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aeb122e7065445abe06982580478a31', 'request_id': 'req-0cad8009-e5f5-4d64-b997-af00ceb17b6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:52.696610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aeb122e7065445abe06982580478a31', 'request_id': 'req-0cad8009-e5f5-4d64-b997-af00ceb17b6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:52.708476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aeb122e7065445abe06982580478a31', 'request_id': 'req-0cad8009-e5f5-4d64-b997-af00ceb17b6f'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:52.727197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] The token cache is being invalidate because project 4aeb122e7065445abe06982580478a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:52.727486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:52.728174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:52.743758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1261/2525] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:52 2022] DELETE /identity/v3/projects/4aeb122e7065445abe06982580478a31 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:56.416879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347355e-cb4b-4fec-82f0-5a0c43dc8a15 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:56.417811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347355e-cb4b-4fec-82f0-5a0c43dc8a15 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:56.418272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347355e-cb4b-4fec-82f0-5a0c43dc8a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:56.448919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:56.452420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9347355e-cb4b-4fec-82f0-5a0c43dc8a15 None None] MFA Rules not processed for user `a4c2be72467a46f4a2f5fb66f66c4ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:56.454690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9347355e-cb4b-4fec-82f0-5a0c43dc8a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:56.535120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1265/2526] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:56.552377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:56.554114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:56.641247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8009-e5f5-4d64-b997-af00ceb17b6f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:56.648151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:56.649216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:56.649508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:56.649784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:56.651712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:56.700212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:56.712203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:56.713922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:56.725114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1262/2527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:06.530851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=28 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:06.720785 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:15.619724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc370a25-9b12-4281-8f2b-dcca5595fd87 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.620249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc370a25-9b12-4281-8f2b-dcca5595fd87 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.620249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc370a25-9b12-4281-8f2b-dcca5595fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.640346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bc370a25-9b12-4281-8f2b-dcca5595fd87 None None] MFA Rules not processed for user `c0a8c6c7a9184df8bb471c0f68813a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:15.641569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bc370a25-9b12-4281-8f2b-dcca5595fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.649468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1266/2528] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:16.055409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.056937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.119922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7487b1-6b34-4f5e-9270-4446f2e0f285 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.123700 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.124545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.124911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.125158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.126938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.137299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.138988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.147853 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1263/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:25.634693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:26.144713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=26 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:28.777457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.778022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.778295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.799272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:28.800487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.862544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1267/2530] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:38.853930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=25 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:39.725127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.726707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.775807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aab212-93ec-4388-938a-f05e93b8ba6a service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.779941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493433d-33c5-4043-a7e3-9fcc3730a55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.780527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493433d-33c5-4043-a7e3-9fcc3730a55e service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.780801 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493433d-33c5-4043-a7e3-9fcc3730a55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.781058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493433d-33c5-4043-a7e3-9fcc3730a55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.812631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493433d-33c5-4043-a7e3-9fcc3730a55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.814225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493433d-33c5-4043-a7e3-9fcc3730a55e service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.824126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1264/2531] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:49.819550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=28 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:47.053440 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:47.055143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:47.175818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be16d79-9cfd-47aa-a8c9-d000df8a99c3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:47.181555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:47.182194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:47.182467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:47.182734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:47.184483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:47.195944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:47.197775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:47.207944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1268/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:57.203514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=53 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:02.518127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f04a-9ade-477c-a5f9-c17ea4f9881a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:02.518698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f04a-9ade-477c-a5f9-c17ea4f9881a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:02.518815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f04a-9ade-477c-a5f9-c17ea4f9881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:02.538395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c902f04a-9ade-477c-a5f9-c17ea4f9881a None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:02.539714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c902f04a-9ade-477c-a5f9-c17ea4f9881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:02.546936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1265/2533] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:45:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:12.533246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:15.018332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:15.054806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2bb14-9873-4ce6-926c-459bf8104625 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:15.060949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:15.061552 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:15.061828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:15.062151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:15.063869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:15.074463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:15.076061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:15.085110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1269/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:25.080969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=13 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:39.544776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902f04a-9ade-477c-a5f9-c17ea4f9881a None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:39.566744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902f04a-9ade-477c-a5f9-c17ea4f9881a None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:39.570763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:39.571359 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:39.571631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:39.571877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:39.573675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:39.601191 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:39.602650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:39.614541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1266/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:40.809675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:40.821548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619498f-4a26-4447-9e16-2b62accde956 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:40.825258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f707ef8-8953-469b-9b61-abed7b0e9da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:40.825888 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707ef8-8953-469b-9b61-abed7b0e9da4 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:40.826162 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707ef8-8953-469b-9b61-abed7b0e9da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:40.826427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707ef8-8953-469b-9b61-abed7b0e9da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:40.828508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3f707ef8-8953-469b-9b61-abed7b0e9da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:40.843596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f707ef8-8953-469b-9b61-abed7b0e9da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:40.845031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f707ef8-8953-469b-9b61-abed7b0e9da4 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:40.856227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1270/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:46.727523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:46.739051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d46db-66cf-4ae9-b2c8-a878c4df73c4 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.743736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.744633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.745155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.745628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.747921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:46.776277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.777819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.787303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1267/2537] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:47.894673 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bd1e-b7a8-4893-81a4-faacabdcc78e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:47.895707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bd1e-b7a8-4893-81a4-faacabdcc78e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:47.895707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bd1e-b7a8-4893-81a4-faacabdcc78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:47.915852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5346bd1e-b7a8-4893-81a4-faacabdcc78e None None] MFA Rules not processed for user `c0a8c6c7a9184df8bb471c0f68813a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:47.917041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5346bd1e-b7a8-4893-81a4-faacabdcc78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:47.925319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1271/2538] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:56.783362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=26 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:57.910735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=9 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:29.987999 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:29.997250 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1f5b-ce81-4179-901e-c91f23ab885b service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:30.001735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746c562-c2ce-41da-ba42-d21520afc060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:30.002371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746c562-c2ce-41da-ba42-d21520afc060 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:30.002645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746c562-c2ce-41da-ba42-d21520afc060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:30.002983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746c562-c2ce-41da-ba42-d21520afc060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:30.005012 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e746c562-c2ce-41da-ba42-d21520afc060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:30.069650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746c562-c2ce-41da-ba42-d21520afc060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:30.071127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746c562-c2ce-41da-ba42-d21520afc060 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:30.080943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1268/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:35.936085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:35.936660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:35.936660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:35.956501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:35.957833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:35.965815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1272/2540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:46:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:40.076435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=30 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:45.950748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:48.713428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:48.714039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:48.714039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:48.734475 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] MFA Rules not processed for user `c0a8c6c7a9184df8bb471c0f68813a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:48.736427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:48.748698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1269/2541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:47:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:49.565228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:49.566679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:49.582029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592589b4-524d-4577-9d5a-792ca4837d51 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:49.587875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:49.588490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:49.588756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:49.589015 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:49.591039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:49.603544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:49.605084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:49.617833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1273/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:52.739412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:52.740981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:52.759474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49e217-1c69-4d31-a0aa-49d5cefc6886 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:52.765835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:52.766459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:52.767094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:52.767538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:52.769731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:52.784122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:52.785768 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:52.797045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1270/2543] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:56.876739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:56.890042 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39abd7-d986-4be8-9d07-aae5cd0cd78f service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:56.896670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:56.897266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:56.897540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:56.897780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:56.906301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:56.907897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:56.916853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1274/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:02.792642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=9 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:06.913094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=12 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:08.079143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:08.090860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c5936-3f6a-49be-9424-dca434eee4f4 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:08.097278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:08.097924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:08.098196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:08.098463 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:08.100239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:08.112739 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:08.114356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:08.125516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1271/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:13.427762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:13.440548 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675220-b94a-4969-86a1-e037ce940519 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:13.446423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9f4b5-520e-4daf-bc0c-07fbc402f470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:13.447021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f4b5-520e-4daf-bc0c-07fbc402f470 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:13.447292 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f4b5-520e-4daf-bc0c-07fbc402f470 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:13.447556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f4b5-520e-4daf-bc0c-07fbc402f470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:13.449310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-89f9f4b5-520e-4daf-bc0c-07fbc402f470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:13.463127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9f4b5-520e-4daf-bc0c-07fbc402f470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:13.464729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9f4b5-520e-4daf-bc0c-07fbc402f470 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:13.475318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1275/2546] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:17.279570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:17.292635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afd8b2-0f22-4e58-b306-f25a44712a4a service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:17.299495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:17.300118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:17.300597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:17.300919 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:17.303100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:17.322666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:17.324427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:17.339035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1272/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:23.470890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:24.472290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc80f1-428f-4f5b-9e85-5f547019be5a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:24.472908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc80f1-428f-4f5b-9e85-5f547019be5a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:24.472908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc80f1-428f-4f5b-9e85-5f547019be5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:24.493048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f5cc80f1-428f-4f5b-9e85-5f547019be5a None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:24.494414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f5cc80f1-428f-4f5b-9e85-5f547019be5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:24.501577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1276/2548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:48:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:24.703208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:24.713624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d888883-a3a5-44cd-9653-2dc32fed41c2 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:24.718017 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56862262-076a-48ff-91ce-959bb314fb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:24.718860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862262-076a-48ff-91ce-959bb314fb21 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:24.719292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862262-076a-48ff-91ce-959bb314fb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:24.719781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862262-076a-48ff-91ce-959bb314fb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:24.722499 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-56862262-076a-48ff-91ce-959bb314fb21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:24.733100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56862262-076a-48ff-91ce-959bb314fb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:24.734865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56862262-076a-48ff-91ce-959bb314fb21 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:24.745101 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1273/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:25.171633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761cbc8-d595-42a7-a22d-fded406a43b3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:25.171984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761cbc8-d595-42a7-a22d-fded406a43b3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:25.172317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761cbc8-d595-42a7-a22d-fded406a43b3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:25.173768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1277/2550] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:48:25.180380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338766b-acee-48e4-ab0c-00bc1c50305c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:25.180663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338766b-acee-48e4-ab0c-00bc1c50305c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:25.180940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338766b-acee-48e4-ab0c-00bc1c50305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:25.273817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e338766b-acee-48e4-ab0c-00bc1c50305c None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:25.275125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e338766b-acee-48e4-ab0c-00bc1c50305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:25.285159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1274/2551] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:48:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:25.296143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761cbc8-d595-42a7-a22d-fded406a43b3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:25.307080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761cbc8-d595-42a7-a22d-fded406a43b3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:25.310579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:25.311181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:25.311455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:25.311722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:25.322138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:25.323586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:25.335075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1278/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:35.271100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=35 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:35.329962 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=9 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:44.250815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2f5f-796d-4d6b-8508-fbb161219050 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:44.251671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2f5f-796d-4d6b-8508-fbb161219050 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:44.251671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2f5f-796d-4d6b-8508-fbb161219050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:44.275642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-c23f2f5f-796d-4d6b-8508-fbb161219050 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:44.276940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c23f2f5f-796d-4d6b-8508-fbb161219050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:44.285117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1275/2553] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:48:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:44.516414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:44.529076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e0f7-3a55-4e3e-9f7a-a477e283543f service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:44.533640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71ff9f-f87e-4b4e-84f8-63c756191687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:44.534269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff9f-f87e-4b4e-84f8-63c756191687 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:44.534536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff9f-f87e-4b4e-84f8-63c756191687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:44.534796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff9f-f87e-4b4e-84f8-63c756191687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:44.542748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ff9f-f87e-4b4e-84f8-63c756191687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:44.544193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71ff9f-f87e-4b4e-84f8-63c756191687 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:44.552326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1279/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:44.982828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33975-64a7-4c9a-bd36-ba258d6d72da None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:44.983098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33975-64a7-4c9a-bd36-ba258d6d72da None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:44.983399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33975-64a7-4c9a-bd36-ba258d6d72da None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:44.984855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1276/2555] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:48:44.990865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0791f6-20f8-435c-addf-98a745d3fe86 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:44.991122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0791f6-20f8-435c-addf-98a745d3fe86 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:44.991409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0791f6-20f8-435c-addf-98a745d3fe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:45.014487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7b0791f6-20f8-435c-addf-98a745d3fe86 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:45.015709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7b0791f6-20f8-435c-addf-98a745d3fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:45.026216 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1280/2556] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:48:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:45.036748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33975-64a7-4c9a-bd36-ba258d6d72da None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:45.049309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33975-64a7-4c9a-bd36-ba258d6d72da None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:45.052943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:45.053563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:45.053864 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:45.054130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:45.064485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:45.065964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:45.076696 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1277/2557] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:55.008747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=9 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:55.072387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=9 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:12.656420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb389-7429-4583-95a0-27dd98e5f6a9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:12.656939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb389-7429-4583-95a0-27dd98e5f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:12.657215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb389-7429-4583-95a0-27dd98e5f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:12.678778 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-730cb389-7429-4583-95a0-27dd98e5f6a9 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:12.680011 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-730cb389-7429-4583-95a0-27dd98e5f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:12.687301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1281/2558] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:49:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:49:22.671408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:52.316787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:52.329813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd07554-2a71-4674-86dc-8d36aabb9a0f service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:52.335138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:52.335778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:52.336059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:52.336321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:52.346222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:52.347819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:52.358218 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1278/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:02.353657 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:16.964810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb389-7429-4583-95a0-27dd98e5f6a9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:16.975116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb389-7429-4583-95a0-27dd98e5f6a9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:16.978683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:16.979310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.979604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.979865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.981546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:17.066103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:17.067557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:17.086396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1282/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:23.217524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.232888 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd56de-aa03-4eea-925f-983baa5e48be service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.240018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.240661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.241015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.241965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.244481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.258253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.264899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.284369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1279/2561] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:23.321061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.322834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.335652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4ac5-9101-412b-9d0f-bf51b4d8c845 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.340341 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.341297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.341568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.342029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] PATH_INFO: `/v3/users/c0a8c6c7a9184df8bb471c0f68813a0f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.343339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a8c6c7a9184df8bb471c0f68813a0f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.345262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.394137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a8c6c7a9184df8bb471c0f68813a0f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.403051 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a8c6c7a9184df8bb471c0f68813a0f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.403754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a8c6c7a9184df8bb471c0f68813a0f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.404349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a8c6c7a9184df8bb471c0f68813a0f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.425817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a8c6c7a9184df8bb471c0f68813a0f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.441731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1283/2562] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:23 2022] DELETE /identity/v3/users/c0a8c6c7a9184df8bb471c0f68813a0f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:23.944390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.958981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449b5e-45db-4144-8c70-09660ad3d8ab service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.018125 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.018757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.019031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.019322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] PATH_INFO: `/v3/projects/3db30626cbec44e19871e9ca61fd785b` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.020510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db30626cbec44e19871e9ca61fd785b)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.022462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.071913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db30626cbec44e19871e9ca61fd785b', 'request_id': 'req-3f90fdbb-a90e-4cef-a047-9538a918b665'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.077575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db30626cbec44e19871e9ca61fd785b', 'request_id': 'req-3f90fdbb-a90e-4cef-a047-9538a918b665'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.086203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db30626cbec44e19871e9ca61fd785b', 'request_id': 'req-3f90fdbb-a90e-4cef-a047-9538a918b665'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.097683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] The token cache is being invalidate because project 3db30626cbec44e19871e9ca61fd785b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:24.097990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.098624 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.100110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1280/2563] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:23 2022] DELETE /identity/v3/projects/3db30626cbec44e19871e9ca61fd785b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:24.104243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.105714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:24.119429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7080f2-b720-428f-bb54-4d4ccf3a186e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.153911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:24.179494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.180121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.180393 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.180702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] PATH_INFO: `/v3/users/a4c2be72467a46f4a2f5fb66f66c4ede` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.181905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c2be72467a46f4a2f5fb66f66c4ede)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.183868 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.232975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c2be72467a46f4a2f5fb66f66c4ede'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.240008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c2be72467a46f4a2f5fb66f66c4ede'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.240680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c2be72467a46f4a2f5fb66f66c4ede'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.241298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c2be72467a46f4a2f5fb66f66c4ede'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.253181 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c2be72467a46f4a2f5fb66f66c4ede'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.266399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1284/2564] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:24 2022] DELETE /identity/v3/users/a4c2be72467a46f4a2f5fb66f66c4ede => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:24.445398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.446952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:24.461110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fdbb-a90e-4cef-a047-9538a918b665 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.521185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.521830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.522120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.522385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] PATH_INFO: `/v3/projects/cc902c29069d451b83463b45d772e2d2` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.523498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc902c29069d451b83463b45d772e2d2)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.525753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.547014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:24.575622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc902c29069d451b83463b45d772e2d2', 'request_id': 'req-74dc741f-35c7-4c79-bbf3-1695e6695439'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.581738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc902c29069d451b83463b45d772e2d2', 'request_id': 'req-74dc741f-35c7-4c79-bbf3-1695e6695439'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.591285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc902c29069d451b83463b45d772e2d2', 'request_id': 'req-74dc741f-35c7-4c79-bbf3-1695e6695439'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.603406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] The token cache is being invalidate because project cc902c29069d451b83463b45d772e2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:24.603689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.604434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:24.606083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1281/2565] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:24 2022] DELETE /identity/v3/projects/cc902c29069d451b83463b45d772e2d2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:29.846475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:29.848174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:29.907844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c76a8-9c92-4446-a482-2adcec698d92 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:29.959243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00602af-29bd-42cf-8c04-9d6fdfe5a5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:29.959845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00602af-29bd-42cf-8c04-9d6fdfe5a5ee service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.960115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00602af-29bd-42cf-8c04-9d6fdfe5a5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.960379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00602af-29bd-42cf-8c04-9d6fdfe5a5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.962501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d00602af-29bd-42cf-8c04-9d6fdfe5a5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:29.990044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:30.051766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00602af-29bd-42cf-8c04-9d6fdfe5a5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:30.053213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00602af-29bd-42cf-8c04-9d6fdfe5a5ee service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:30.071864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1285/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:34.600078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:39.650171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:39.651582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:39.667778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc741f-35c7-4c79-bbf3-1695e6695439 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:39.671616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:39.672232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:39.672505 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:39.672758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:39.674704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:39.748575 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:39.750062 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:39.761557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1282/2567] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:40.068869 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=28 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:49.756430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=34 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:50.187643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbcd6a-30f3-47c3-865f-299e55296ec6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:50.188132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbcd6a-30f3-47c3-865f-299e55296ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:50.188203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbcd6a-30f3-47c3-865f-299e55296ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:50.218539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cfdbcd6a-30f3-47c3-865f-299e55296ec6 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:50.219769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cfdbcd6a-30f3-47c3-865f-299e55296ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:50.227940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1286/2568] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:50:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:50.928216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:50.929587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:50.946534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487dd5-6aae-42f8-a8e2-637d6d6996b8 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:50.951563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:50.952390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:50.952829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:50.953606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:50.955591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:50.996763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:50.998595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:51.014233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1283/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:53.319764 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbcd6a-30f3-47c3-865f-299e55296ec6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:53.330580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbcd6a-30f3-47c3-865f-299e55296ec6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:53.334650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:53.335367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:53.335867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:53.336227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:53.338294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:53.350764 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:53.352271 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:53.360937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1287/2570] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:01.008592 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:03.357877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=12 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:14.700520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:14.704177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:14.750263 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca57512-364d-43a9-a833-c004c7fd345b service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:14.755764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f8c5f-40de-4245-9dbb-3d2ee58ab1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:14.756383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f8c5f-40de-4245-9dbb-3d2ee58ab1a2 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:14.756660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f8c5f-40de-4245-9dbb-3d2ee58ab1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:14.756928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f8c5f-40de-4245-9dbb-3d2ee58ab1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:14.758688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-af4f8c5f-40de-4245-9dbb-3d2ee58ab1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:14.771546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f8c5f-40de-4245-9dbb-3d2ee58ab1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:14.773124 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f8c5f-40de-4245-9dbb-3d2ee58ab1a2 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:14.786177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1284/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:23.490676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:23.508954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6e4b-962f-48e3-89c4-0c860e08246b service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:23.513076 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:23.513754 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:23.514169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:23.514803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:23.516990 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:23.605509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:23.606925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:23.627302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1288/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:24.781004 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=16 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:27.988200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:27.989234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:27.989516 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:28.011854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:28.013674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:28.022683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1285/2573] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:54:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:28.375842 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:28.388663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08878ab6-3d41-4ab3-9ef2-3f0756a01ab0 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:28.392945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:28.393561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:28.393939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:28.394213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:28.396122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:28.406643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:28.408060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:28.417032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1289/2574] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:28.753320 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:28.755244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:28.832362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e98237-4b2a-45d7-bb29-6b3d78eabddd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:28.837311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d8980-2dc5-4c99-95d2-cb1fe407c0d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:28.838300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d8980-2dc5-4c99-95d2-cb1fe407c0d0 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:28.838717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d8980-2dc5-4c99-95d2-cb1fe407c0d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:28.838988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d8980-2dc5-4c99-95d2-cb1fe407c0d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:28.840733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5a2d8980-2dc5-4c99-95d2-cb1fe407c0d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:28.853032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d8980-2dc5-4c99-95d2-cb1fe407c0d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:28.854660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d8980-2dc5-4c99-95d2-cb1fe407c0d0 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:28.865352 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1286/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:37.917451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:37.919129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:37.937531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9a8c-47ea-4c5f-b373-b754fe4a224b service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:37.943960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:37.944581 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:37.944857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:37.945119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:37.946918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:37.959808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:37.961402 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:37.972222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1290/2576] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:38.861089 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=35 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:44.199396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.200061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.200061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.220809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:44.222265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:44.230627 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1287/2577] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:54:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:44.550865 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:44.561282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60acc8-707d-4169-a2f1-d6b84129c126 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:44.566079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.566668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.566937 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.567195 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.569102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:44.579088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.580590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.589082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1291/2578] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:54.214209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:54.585168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=64 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:58.047614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:58.049152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:58.112687 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503387ca-e61a-42c0-9648-b8cb966c5748 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:58.118873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:58.119472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:58.119742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:58.119975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:58.122128 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:58.134113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:58.135681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:58.146045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1288/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:08.141404 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=27 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:00.570040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:00.592608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abbd2-7d89-4c35-8262-6059d97928f0 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:00.597769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:00.598397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:00.598674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:00.598943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:00.607120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:00.608547 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:00.617514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1292/2580] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:56:10.613649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=12 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:11.919592 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:11.931894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68cf9-e56c-4f6f-bf2a-4bff4dc484cf service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:11.936992 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:11.937590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:11.937881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:11.938145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:11.947201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:11.948751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:11.957639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1289/2581] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:13.125454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:13.159152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ca6c-f2ce-403d-83c9-5e5f5c117716 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:13.164961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:13.165560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:13.165829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:13.166115 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:13.168105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:13.194974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:13.196610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:13.207631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1293/2582] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:20.580277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:20.589655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda8bb-806d-49fc-b426-d6ee541624f0 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:20.595433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:20.596253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:20.596535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:20.596806 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:20.619802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:20.619802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:20.636788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1290/2583] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:21.842028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:21.851822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336bed-5b7c-4291-88bb-c57d5f3f9cbf service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:21.856065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cdf06-7290-42ea-8200-1a7550966112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:21.856701 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cdf06-7290-42ea-8200-1a7550966112 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:21.856971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cdf06-7290-42ea-8200-1a7550966112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:21.857234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cdf06-7290-42ea-8200-1a7550966112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:21.868509 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cdf06-7290-42ea-8200-1a7550966112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:21.869980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cdf06-7290-42ea-8200-1a7550966112 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:21.881562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1294/2584] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:30.624211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:31.876837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=24 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:32.595933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:32.607501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad6858-1f3a-4659-a12c-fbd0dab8e75f service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:32.612944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:32.613561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:32.613865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:32.614114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:32.616175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:32.631978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:32.633834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:32.645680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1291/2585] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:38.632091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107bf34-072c-45af-9556-999d69a58504 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:38.632584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107bf34-072c-45af-9556-999d69a58504 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:38.632692 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107bf34-072c-45af-9556-999d69a58504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:38.652121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2107bf34-072c-45af-9556-999d69a58504 None None] MFA Rules not processed for user `78cecb18ae6e49868cc9b1e9d65fe697`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:38.653328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2107bf34-072c-45af-9556-999d69a58504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:38.660405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1295/2586] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:56:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:56:42.640929 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:48.645956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:11.545466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:11.556525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc8dd-18d7-4c2e-9b4d-bb950e965c5b service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:11.561773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4611457-c21e-4dc9-92b1-fb322dc4851c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:11.562437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4611457-c21e-4dc9-92b1-fb322dc4851c service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:11.562706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4611457-c21e-4dc9-92b1-fb322dc4851c service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:11.562974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4611457-c21e-4dc9-92b1-fb322dc4851c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:11.564726 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f4611457-c21e-4dc9-92b1-fb322dc4851c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:11.576865 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4611457-c21e-4dc9-92b1-fb322dc4851c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:11.578477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4611457-c21e-4dc9-92b1-fb322dc4851c service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:11.591166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1292/2587] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:11.629225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107bf34-072c-45af-9556-999d69a58504 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:11.630923 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2107bf34-072c-45af-9556-999d69a58504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:11.699515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107bf34-072c-45af-9556-999d69a58504 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:11.704995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:11.705633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:11.705947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:11.706220 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] PATH_INFO: `/v3/users/78cecb18ae6e49868cc9b1e9d65fe697` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:11.708121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=78cecb18ae6e49868cc9b1e9d65fe697)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:11.710149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:11.769392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78cecb18ae6e49868cc9b1e9d65fe697'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.777146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78cecb18ae6e49868cc9b1e9d65fe697'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.777823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78cecb18ae6e49868cc9b1e9d65fe697'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.778562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78cecb18ae6e49868cc9b1e9d65fe697'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.792312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78cecb18ae6e49868cc9b1e9d65fe697'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.807392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1296/2588] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:11 2022] DELETE /identity/v3/users/78cecb18ae6e49868cc9b1e9d65fe697 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:11.812118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:11.812392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:11.812652 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:11.844501 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:11.846259 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:11.917067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1293/2589] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:11.926910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:11.928400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:11.999855 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9849-b428-4db3-b7ab-ef2a976470cb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:12.003813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:12.004489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:12.004767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:12.005037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:12.014834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:12.016557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:12.027619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1297/2590] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:12.211784 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:12.213315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:12.235380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449b50b-2a69-4841-895e-c991b5d77ff2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:12.240680 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:12.241401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:12.241756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:12.242145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] PATH_INFO: `/v3/projects/a6a0bef5dc2e48f4b7dca32a9a54264f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:12.243434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a0bef5dc2e48f4b7dca32a9a54264f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:12.245610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:12.298479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a0bef5dc2e48f4b7dca32a9a54264f', 'request_id': 'req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.305596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a0bef5dc2e48f4b7dca32a9a54264f', 'request_id': 'req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.314418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a0bef5dc2e48f4b7dca32a9a54264f', 'request_id': 'req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.325928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] The token cache is being invalidate because project a6a0bef5dc2e48f4b7dca32a9a54264f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:12.326159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.326819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.328339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1294/2591] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:12 2022] DELETE /identity/v3/projects/a6a0bef5dc2e48f4b7dca32a9a54264f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:12.332787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:12.343364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84981beb-5119-4127-950f-adefb9e336a0 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:12.351276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:12.404063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:12.404689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:12.404980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:12.405240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] PATH_INFO: `/v3/users/f99bb0d1674640f5bea24165fae25daf` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:12.406443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99bb0d1674640f5bea24165fae25daf)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:12.408405 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:12.456323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99bb0d1674640f5bea24165fae25daf'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.463710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99bb0d1674640f5bea24165fae25daf'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.464450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99bb0d1674640f5bea24165fae25daf'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.465155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99bb0d1674640f5bea24165fae25daf'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.478399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-43383d40-414a-422a-97fe-a775dfbd3db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99bb0d1674640f5bea24165fae25daf'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.492844 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1298/2592] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:12 2022] DELETE /identity/v3/users/f99bb0d1674640f5bea24165fae25daf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:12.810791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:12.812368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:12.827828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6497bd-6ae0-44bb-b30a-5c3482c91e56 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:12.887609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:12.888160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:12.888436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:12.888704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] PATH_INFO: `/v3/projects/8c0a70a1e7304db4a8ec405fc04060d7` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:12.889894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0a70a1e7304db4a8ec405fc04060d7)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:12.891742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:12.898281 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:12.946814 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0a70a1e7304db4a8ec405fc04060d7', 'request_id': 'req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.952378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0a70a1e7304db4a8ec405fc04060d7', 'request_id': 'req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.961285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0a70a1e7304db4a8ec405fc04060d7', 'request_id': 'req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.972569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] The token cache is being invalidate because project 8c0a70a1e7304db4a8ec405fc04060d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:12.972859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.973533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f37fa1e3-9f9d-44a2-ba5d-19841a86ead9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.975069 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1295/2593] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:12 2022] DELETE /identity/v3/projects/8c0a70a1e7304db4a8ec405fc04060d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:18.699163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba863ec7-b865-45ca-9cb7-2dc4c4e9b249 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:18.699741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba863ec7-b865-45ca-9cb7-2dc4c4e9b249 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:18.699741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba863ec7-b865-45ca-9cb7-2dc4c4e9b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:18.742249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ba863ec7-b865-45ca-9cb7-2dc4c4e9b249 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:18.743486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ba863ec7-b865-45ca-9cb7-2dc4c4e9b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:18.821469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1299/2594] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:18.830834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a4ef-3ba5-44a2-a006-6b6b1e349979 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:18.831303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a4ef-3ba5-44a2-a006-6b6b1e349979 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:18.831407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a4ef-3ba5-44a2-a006-6b6b1e349979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:18.852755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1420a4ef-3ba5-44a2-a006-6b6b1e349979 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:18.853991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1420a4ef-3ba5-44a2-a006-6b6b1e349979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:18.863369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1296/2595] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:18.868244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba863ec7-b865-45ca-9cb7-2dc4c4e9b249 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:18.879270 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba863ec7-b865-45ca-9cb7-2dc4c4e9b249 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:18.885087 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:18.885736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:18.886037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:18.886298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:18.886928 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:18.887260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:18.888867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:18.901785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1300/2596] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:18.909809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420a4ef-3ba5-44a2-a006-6b6b1e349979 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:18.919043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420a4ef-3ba5-44a2-a006-6b6b1e349979 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:18.924139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:18.924764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:18.925029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:18.925292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:18.926015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:18.927903 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:18.966170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1297/2597] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:18 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:18.970501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:18.976192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:18.982143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becd430-d65a-47c2-88b2-60c9ad84bef4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.041476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.042130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.042398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.042669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.043289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.045222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.067067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1301/2598] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:18 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:19.071381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.082051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ad899-c0da-49e2-9668-b1ceba12aa1e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.087008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.087607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.087842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.088142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.088773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.090411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.100540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1298/2599] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:19.104595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.114858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e60a-2857-4639-9399-dbcd5e9b1e82 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.119894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1474c-0aaf-4f12-b040-4b950d3d1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.120478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1474c-0aaf-4f12-b040-4b950d3d1009 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.120749 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1474c-0aaf-4f12-b040-4b950d3d1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.121010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1474c-0aaf-4f12-b040-4b950d3d1009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.121663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1474c-0aaf-4f12-b040-4b950d3d1009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.123313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1474c-0aaf-4f12-b040-4b950d3d1009 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.134715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1302/2600] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:19.139454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.152365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fb502-b91d-4a35-83d0-d7c2e669e17f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.158185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.158839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.159122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.159391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] PATH_INFO: `/v3/projects/0474f342421e4d7f9dfaa872d4c0f6b3/users/d0faebe83f284758b74afabb958d4065/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.174478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0474f342421e4d7f9dfaa872d4c0f6b3, user_id=d0faebe83f284758b74afabb958d4065, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.177316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.192297 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1299/2601] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:19 2022] PUT /identity/v3/projects/0474f342421e4d7f9dfaa872d4c0f6b3/users/d0faebe83f284758b74afabb958d4065/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:19.205476 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7da07-0b7a-46d7-9f30-df25d6f3e9f9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.205736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7da07-0b7a-46d7-9f30-df25d6f3e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.206032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7da07-0b7a-46d7-9f30-df25d6f3e9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.235004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dcb7da07-0b7a-46d7-9f30-df25d6f3e9f9 None None] MFA Rules not processed for user `d0faebe83f284758b74afabb958d4065`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:19.236197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dcb7da07-0b7a-46d7-9f30-df25d6f3e9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:19.310762 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1303/2602] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:19.315594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.381205 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ceb79-2bac-4e5d-b9fe-5b498b23aca7 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.386880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.387415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.387694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.387962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.388581 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.390541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.419290 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1300/2603] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:19 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:19.425721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7da07-0b7a-46d7-9f30-df25d6f3e9f9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.436849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7da07-0b7a-46d7-9f30-df25d6f3e9f9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.501686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.502318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.502597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.502846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.503462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.505852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.525215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:19.531091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1304/2604] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:19 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:19.535857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.546031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab245-bed1-480f-a389-8ca9e5bd925e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.551995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.552618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.552886 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.553147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.553839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.555496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.556754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:19.568448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1301/2605] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:58:19.572714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.583112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea260df-3157-4386-9b82-b64ed8c76162 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.588215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.588870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.589138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.589410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] PATH_INFO: `/v3/projects/2baefead4a68460db565ee98d092cb10/users/2e79b15dc12549d6bf5e48dc03ad34f6/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.604487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2baefead4a68460db565ee98d092cb10, user_id=2e79b15dc12549d6bf5e48dc03ad34f6, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.607285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.621816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1305/2606] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:19 2022] PUT /identity/v3/projects/2baefead4a68460db565ee98d092cb10/users/2e79b15dc12549d6bf5e48dc03ad34f6/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:19.626076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.636655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266cd54-c11b-4428-9642-f74a7370b6c8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.696747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe038c1b-e3ae-4b65-9720-0900a3477e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.697302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe038c1b-e3ae-4b65-9720-0900a3477e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.697578 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe038c1b-e3ae-4b65-9720-0900a3477e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.697873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe038c1b-e3ae-4b65-9720-0900a3477e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.698513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe038c1b-e3ae-4b65-9720-0900a3477e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.700115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe038c1b-e3ae-4b65-9720-0900a3477e5c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.710659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1302/2607] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:19.717191 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.734653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31dee-6db7-4499-8804-a97fb362ee05 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.742352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087214c-f632-472f-baff-d2f62e2518fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.743005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087214c-f632-472f-baff-d2f62e2518fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.743275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087214c-f632-472f-baff-d2f62e2518fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.743535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087214c-f632-472f-baff-d2f62e2518fa admin admin] PATH_INFO: `/v3/projects/2baefead4a68460db565ee98d092cb10/users/2e79b15dc12549d6bf5e48dc03ad34f6/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.745731 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087214c-f632-472f-baff-d2f62e2518fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2baefead4a68460db565ee98d092cb10, user_id=2e79b15dc12549d6bf5e48dc03ad34f6, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.748426 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087214c-f632-472f-baff-d2f62e2518fa admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.760268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1306/2608] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:19 2022] PUT /identity/v3/projects/2baefead4a68460db565ee98d092cb10/users/2e79b15dc12549d6bf5e48dc03ad34f6/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:19.771206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.771789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.772340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.809294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] MFA Rules not processed for user `2e79b15dc12549d6bf5e48dc03ad34f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:19.810597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:19.889136 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1303/2609] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:19.903640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.903924 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.904189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.924315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] MFA Rules not processed for user `d0faebe83f284758b74afabb958d4065`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:19.925524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:19.984199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1307/2610] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:19.999883 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.002389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:20.093285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d517-6380-4d58-9525-35316f37a7cc None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.099825 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bdead-22e4-41ab-b0d6-b9a87dbfc6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.100461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bdead-22e4-41ab-b0d6-b9a87dbfc6b2 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.100736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bdead-22e4-41ab-b0d6-b9a87dbfc6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.100984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bdead-22e4-41ab-b0d6-b9a87dbfc6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.109551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bdead-22e4-41ab-b0d6-b9a87dbfc6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.111182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bdead-22e4-41ab-b0d6-b9a87dbfc6b2 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.120246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1304/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:29.976267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=40,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:30.116319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:34.055952 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:34.057515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:34.074009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf52d2a-2e03-40ea-b452-cc108cc7fedc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.080406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.080999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.081275 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.081539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.090334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.091929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.101983 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1308/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:34.119321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880e9d-7d7d-4144-afdf-afe910016de3 None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.119751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880e9d-7d7d-4144-afdf-afe910016de3 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.119751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880e9d-7d7d-4144-afdf-afe910016de3 None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.121141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1305/2613] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 30 09:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:58:34.125830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] Authenticating service token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:58:34.137563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 30 09:58:34.137893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:34.146992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bedb5a-deac-4062-8a26-461179294f8d service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.153052 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e79b15dc12549d6bf5e48dc03ad34f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2baefead4a68460db565ee98d092cb10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.153682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.153991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.154282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] PATH_INFO: `/v3/projects/2baefead4a68460db565ee98d092cb10` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.155438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] RBAC: Authorizing `identity:get_project(project_id=2baefead4a68460db565ee98d092cb10)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.157218 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.158863 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1309/2614] 10.222.0.20 () {58 vars in 1443 bytes} [Fri Sep 30 09:58:34 2022] GET /identity/v3/projects/2baefead4a68460db565ee98d092cb10 => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:34.529451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d584b9d-8e48-4c22-b1fa-81a630606dbd None None] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.529731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d584b9d-8e48-4c22-b1fa-81a630606dbd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.530030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d584b9d-8e48-4c22-b1fa-81a630606dbd None None] PATH_INFO: `/` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.531372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1306/2615] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 30 09:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:58:34.536828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] Authenticating service token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:58:34.558507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:34.570534 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363a708-92eb-4666-bc66-b04b0c4f67d7 tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.575957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639dfe6-9980-4aca-aff8-a58ce53d292f tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e79b15dc12549d6bf5e48dc03ad34f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2baefead4a68460db565ee98d092cb10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.576577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639dfe6-9980-4aca-aff8-a58ce53d292f tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.576814 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639dfe6-9980-4aca-aff8-a58ce53d292f tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.577099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639dfe6-9980-4aca-aff8-a58ce53d292f tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] PATH_INFO: `/v3/projects/2baefead4a68460db565ee98d092cb10` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.578390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639dfe6-9980-4aca-aff8-a58ce53d292f tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] RBAC: Authorizing `identity:get_project(project_id=2baefead4a68460db565ee98d092cb10)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.580176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639dfe6-9980-4aca-aff8-a58ce53d292f tempest-ServersAdminNegativeTestJSON-1370534741 tempest-ServersAdminNegativeTestJSON-1370534741-project-admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.581881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1310/2616] 10.222.0.20 () {58 vars in 1443 bytes} [Fri Sep 30 09:58:34 2022] GET /identity/v3/projects/2baefead4a68460db565ee98d092cb10 => generated 393 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:58:38.606484 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d584b9d-8e48-4c22-b1fa-81a630606dbd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.673322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d584b9d-8e48-4c22-b1fa-81a630606dbd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.678247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.678881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.679149 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.679415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] PATH_INFO: `/v3/users/d0faebe83f284758b74afabb958d4065` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.680549 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0faebe83f284758b74afabb958d4065)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.682503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.731181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0faebe83f284758b74afabb958d4065'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.731828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0faebe83f284758b74afabb958d4065'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.744029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0faebe83f284758b74afabb958d4065'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.751623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0faebe83f284758b74afabb958d4065'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.752267 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0faebe83f284758b74afabb958d4065'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.768102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1307/2617] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:38 2022] DELETE /identity/v3/users/d0faebe83f284758b74afabb958d4065 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:38.772998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.773896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.773896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.793567 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:38.794811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:38.860225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1311/2618] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:38.870360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.872018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:38.933334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe0832-10a2-4258-ad93-30bc21144b41 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.937194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.937810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.938093 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.938353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.947628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.949049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.962322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1308/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:39.142722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:39.144179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:39.156963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6bd09-b80d-4c91-994a-2fb6e535c240 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:39.162018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:39.162625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.162901 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.163171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] PATH_INFO: `/v3/projects/0474f342421e4d7f9dfaa872d4c0f6b3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:39.164356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0474f342421e4d7f9dfaa872d4c0f6b3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:39.166403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:39.214562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0474f342421e4d7f9dfaa872d4c0f6b3', 'request_id': 'req-23e3cb20-6024-4b64-95ea-a9b94dd6b142'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.220651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0474f342421e4d7f9dfaa872d4c0f6b3', 'request_id': 'req-23e3cb20-6024-4b64-95ea-a9b94dd6b142'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.226391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0474f342421e4d7f9dfaa872d4c0f6b3', 'request_id': 'req-23e3cb20-6024-4b64-95ea-a9b94dd6b142'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.241589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] The token cache is being invalidate because project 0474f342421e4d7f9dfaa872d4c0f6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:39.241905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.242527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.244049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1312/2620] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:39 2022] DELETE /identity/v3/projects/0474f342421e4d7f9dfaa872d4c0f6b3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:39.248241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:39.258041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6530ed-e2f5-4e76-aa0e-549f6bb8e604 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:39.276537 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:39.317994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:39.318636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.318911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.319180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] PATH_INFO: `/v3/users/2e79b15dc12549d6bf5e48dc03ad34f6` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:39.320349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e79b15dc12549d6bf5e48dc03ad34f6)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:39.322311 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:39.380165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e79b15dc12549d6bf5e48dc03ad34f6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.380845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e79b15dc12549d6bf5e48dc03ad34f6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.392823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e79b15dc12549d6bf5e48dc03ad34f6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.399847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e79b15dc12549d6bf5e48dc03ad34f6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.400504 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-cd109293-174e-4ae4-bf3b-36b8b870c2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e79b15dc12549d6bf5e48dc03ad34f6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.413798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1309/2621] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:39 2022] DELETE /identity/v3/users/2e79b15dc12549d6bf5e48dc03ad34f6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:39.708675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:39.710212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:39.725066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3cb20-6024-4b64-95ea-a9b94dd6b142 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:39.779368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:39.790519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:39.791276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.791798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.792142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] PATH_INFO: `/v3/projects/2baefead4a68460db565ee98d092cb10` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:39.793592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2baefead4a68460db565ee98d092cb10)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:39.795568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:39.844148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2baefead4a68460db565ee98d092cb10', 'request_id': 'req-9e0f08c8-f306-4da5-982a-2ff4d63380a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.850237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2baefead4a68460db565ee98d092cb10', 'request_id': 'req-9e0f08c8-f306-4da5-982a-2ff4d63380a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.855629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2baefead4a68460db565ee98d092cb10', 'request_id': 'req-9e0f08c8-f306-4da5-982a-2ff4d63380a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.871202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] The token cache is being invalidate because project 2baefead4a68460db565ee98d092cb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:39.871574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.872521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9e0f08c8-f306-4da5-982a-2ff4d63380a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.874267 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1313/2622] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:39 2022] DELETE /identity/v3/projects/2baefead4a68460db565ee98d092cb10 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:39.880871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498044c1-a7f3-4c54-843b-623269fc361c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.881354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498044c1-a7f3-4c54-843b-623269fc361c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.881445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498044c1-a7f3-4c54-843b-623269fc361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:39.912682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-498044c1-a7f3-4c54-843b-623269fc361c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:39.913960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-498044c1-a7f3-4c54-843b-623269fc361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:39.978234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1310/2623] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:39.986569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14993a41-76f3-4791-a62e-b33bc6cb3fd9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.986846 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14993a41-76f3-4791-a62e-b33bc6cb3fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.987144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14993a41-76f3-4791-a62e-b33bc6cb3fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.007411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-14993a41-76f3-4791-a62e-b33bc6cb3fd9 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:40.008622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-14993a41-76f3-4791-a62e-b33bc6cb3fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:40.016947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1314/2624] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:40.021625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498044c1-a7f3-4c54-843b-623269fc361c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.032152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498044c1-a7f3-4c54-843b-623269fc361c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.037041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.037632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.037930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.038197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.038833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:40.039130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.040751 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.052619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1311/2625] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:40.057176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14993a41-76f3-4791-a62e-b33bc6cb3fd9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.066897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14993a41-76f3-4791-a62e-b33bc6cb3fd9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.072873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.073468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.073741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.074049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.074671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.076597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.106891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1315/2626] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:40 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:40.111300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.121686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7df38-11d1-4c78-81a4-775bac2744c4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.139893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:40.189502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.190165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.190425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.190688 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.191307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.193471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.215612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1312/2627] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:40 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:40.219817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.230568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83375c-a541-4911-b185-ec7c4866cac2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.235646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.236240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.236513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.236788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.237419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.239094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.249600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1316/2628] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:40.253683 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.264059 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa5eed-60d0-4db5-b23b-afe2c646f591 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.269730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf276-602d-4afa-8a41-aca3014329df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.270605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf276-602d-4afa-8a41-aca3014329df admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.270605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf276-602d-4afa-8a41-aca3014329df admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.270899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf276-602d-4afa-8a41-aca3014329df admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.271628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cf276-602d-4afa-8a41-aca3014329df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.273316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cf276-602d-4afa-8a41-aca3014329df admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.285544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1313/2629] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:40.290039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.300333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b96f6-dd76-4c87-9a52-ed30c3f1558e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.305234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.305898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.306169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.306432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] PATH_INFO: `/v3/projects/f920a49cdf1347eaa2eb5c4713bebd6b/users/51edbab4ff004d40971f877ef8958f12/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.323472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f920a49cdf1347eaa2eb5c4713bebd6b, user_id=51edbab4ff004d40971f877ef8958f12, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.326156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.341286 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1317/2630] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:40 2022] PUT /identity/v3/projects/f920a49cdf1347eaa2eb5c4713bebd6b/users/51edbab4ff004d40971f877ef8958f12/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:40.346633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfef35-ff12-4f5f-a798-5b87839fa7c7 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.346921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfef35-ff12-4f5f-a798-5b87839fa7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.347181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfef35-ff12-4f5f-a798-5b87839fa7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.367144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d3cfef35-ff12-4f5f-a798-5b87839fa7c7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:40.368368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d3cfef35-ff12-4f5f-a798-5b87839fa7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:40.433851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1314/2631] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:40.445571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.447502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:40.509515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54044-0feb-4bd0-a163-b57eafdebbb7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.513621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028501c0-0d43-4660-a9d3-41fd5f944f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.514256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028501c0-0d43-4660-a9d3-41fd5f944f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.514519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028501c0-0d43-4660-a9d3-41fd5f944f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.514787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028501c0-0d43-4660-a9d3-41fd5f944f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.524770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028501c0-0d43-4660-a9d3-41fd5f944f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.526269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028501c0-0d43-4660-a9d3-41fd5f944f43 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.536694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1318/2632] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:44.601050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:44.601518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:44.601678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:44.632813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] MFA Rules not processed for user `51edbab4ff004d40971f877ef8958f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:44.634010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:44.700844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1315/2633] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:44.712250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393cd9-9ae8-478a-9f38-dab578cb0e6a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:44.712828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393cd9-9ae8-478a-9f38-dab578cb0e6a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:44.712828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393cd9-9ae8-478a-9f38-dab578cb0e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:44.732693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b4393cd9-9ae8-478a-9f38-dab578cb0e6a None None] MFA Rules not processed for user `51edbab4ff004d40971f877ef8958f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:44.733905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b4393cd9-9ae8-478a-9f38-dab578cb0e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:44.741978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1319/2634] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:58:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:44.755840 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:44.757725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:44.805493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:44.853044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d161dd-d571-46ce-937b-ff4499cb6363 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:44.859018 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf429b8-01e8-4c54-a7e1-c1147cf14ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:44.859655 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf429b8-01e8-4c54-a7e1-c1147cf14ec7 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:44.859927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf429b8-01e8-4c54-a7e1-c1147cf14ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:44.860194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf429b8-01e8-4c54-a7e1-c1147cf14ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:44.868718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf429b8-01e8-4c54-a7e1-c1147cf14ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:44.870387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf429b8-01e8-4c54-a7e1-c1147cf14ec7 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:44.879808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1316/2635] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:54.727146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:54.875398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=21 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:57.728636 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f599d-bf00-4386-9068-3c466a70d394 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:57.729234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f599d-bf00-4386-9068-3c466a70d394 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:57.729234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f599d-bf00-4386-9068-3c466a70d394 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:57.730552 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1320/2636] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 09:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:58:57.736444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:57.736875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:57.736974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:57.788590 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:57.789957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:57.796738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1317/2637] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 09:58:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:57.809177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f599d-bf00-4386-9068-3c466a70d394 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:57.810985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f65f599d-bf00-4386-9068-3c466a70d394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:57.824513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f599d-bf00-4386-9068-3c466a70d394 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:57.828069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:57.828672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:57.828947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:57.829213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:57.836820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:57.838358 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:57.846450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1321/2638] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:57.961670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:57.963371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:58.044109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d5e4-94ba-41d8-b064-b2eeb7c6e8e6 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:58.049728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:58.050363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:58.050636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:58.050904 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:58.052754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:58.066303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:58.068753 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:58.084294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1318/2639] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:58.275958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:58.285157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da1984-a9e4-4bf3-aad2-40de23df17bb service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:58.290818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:58.291411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:58.291679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:58.291944 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:58.294244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:58.308624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:58.310091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:58.320945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1322/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:08.077457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=45 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:08.316468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=12 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:35.469637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:35.476353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97fbaf-4d33-45de-a1f3-ea5a916afcf1 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:35.482096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:35.482714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:35.482985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:35.483304 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:35.485040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:35.498254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:35.500165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:35.512599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1319/2641] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:40.161106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:40.172707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816353c-02f7-4cb9-9e41-b7de238428cd service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:40.178005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:40.178687 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.178904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.179165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] PATH_INFO: `/v3/users/51edbab4ff004d40971f877ef8958f12` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.180306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51edbab4ff004d40971f877ef8958f12)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:40.182314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:40.228802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51edbab4ff004d40971f877ef8958f12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.236140 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51edbab4ff004d40971f877ef8958f12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.236807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51edbab4ff004d40971f877ef8958f12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.237419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51edbab4ff004d40971f877ef8958f12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.249558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e4d5d7e8-71ea-46ab-a665-2631aaf8069f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51edbab4ff004d40971f877ef8958f12'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.264194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1323/2642] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 09:59:40 2022] DELETE /identity/v3/users/51edbab4ff004d40971f877ef8958f12 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:40.449044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:40.460396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1df6-26ab-4a56-bf59-b8c75cfc8827 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:40.519802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:40.520440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.520713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.520980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] PATH_INFO: `/v3/projects/f920a49cdf1347eaa2eb5c4713bebd6b` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.522279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f920a49cdf1347eaa2eb5c4713bebd6b)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:40.524558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:40.574401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f920a49cdf1347eaa2eb5c4713bebd6b', 'request_id': 'req-6056156d-1fcb-4c5c-b23e-299264ada664'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.579791 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f920a49cdf1347eaa2eb5c4713bebd6b', 'request_id': 'req-6056156d-1fcb-4c5c-b23e-299264ada664'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.589447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f920a49cdf1347eaa2eb5c4713bebd6b', 'request_id': 'req-6056156d-1fcb-4c5c-b23e-299264ada664'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.602366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] The token cache is being invalidate because project f920a49cdf1347eaa2eb5c4713bebd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:40.602647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.603276 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-6056156d-1fcb-4c5c-b23e-299264ada664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:40.604915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1320/2643] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:40 2022] DELETE /identity/v3/projects/f920a49cdf1347eaa2eb5c4713bebd6b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:40.610186 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef414d1-122d-49cc-bea2-133de094c047 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.610461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef414d1-122d-49cc-bea2-133de094c047 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.610722 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef414d1-122d-49cc-bea2-133de094c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.631623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0ef414d1-122d-49cc-bea2-133de094c047 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:40.632824 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0ef414d1-122d-49cc-bea2-133de094c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:40.695559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1324/2644] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:40.704445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a2674-f12d-48ef-91a3-665b1abc9505 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.704725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a2674-f12d-48ef-91a3-665b1abc9505 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.704995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a2674-f12d-48ef-91a3-665b1abc9505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.725536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-bc6a2674-f12d-48ef-91a3-665b1abc9505 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:40.726856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-bc6a2674-f12d-48ef-91a3-665b1abc9505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:40.735143 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1321/2645] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:40.739462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef414d1-122d-49cc-bea2-133de094c047 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:40.749975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef414d1-122d-49cc-bea2-133de094c047 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:40.755903 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:40.756502 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.756779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.757046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.757688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:40.758021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:40.759661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:40.773434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1325/2646] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:59:40.779921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a2674-f12d-48ef-91a3-665b1abc9505 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:40.789525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a2674-f12d-48ef-91a3-665b1abc9505 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:40.796855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:40.797457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.797733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.798037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.798667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:40.800603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:40.830385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1322/2647] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:40 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:59:40.834840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:40.845206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ada4-4109-4a58-96d0-1e4279763c01 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:40.903836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:40.904432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.904698 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.904960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.905570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:40.907527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:40.915546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:40.932100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1326/2648] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:40 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:40.936581 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:40.947707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852005-b313-4681-bf31-5df11c8ba913 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:40.954094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:40.954689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.954982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.955269 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.955956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:40.957542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:40.967697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1323/2649] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:40.971768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:40.982172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383042c8-c9a2-4565-a617-fdbd24fac2a2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:40.986975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d34a4-2240-44cf-b334-82294db7bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:40.987569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d34a4-2240-44cf-b334-82294db7bd02 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:40.987841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d34a4-2240-44cf-b334-82294db7bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:40.988104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d34a4-2240-44cf-b334-82294db7bd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:40.988732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d34a4-2240-44cf-b334-82294db7bd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:40.990356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d34a4-2240-44cf-b334-82294db7bd02 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:41.000987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1327/2650] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:41.005174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:41.017384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d756b-361d-431f-b953-c50c0b70d38a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:41.026654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:41.027567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:41.027932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:41.028292 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] PATH_INFO: `/v3/projects/c669c4ec0d6e4e7f8bfb9fc64f26735d/users/06ba7f24fc534ac18c35444278fd878a/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:41.049826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c669c4ec0d6e4e7f8bfb9fc64f26735d, user_id=06ba7f24fc534ac18c35444278fd878a, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:41.052474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:41.068277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1324/2651] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:41 2022] PUT /identity/v3/projects/c669c4ec0d6e4e7f8bfb9fc64f26735d/users/06ba7f24fc534ac18c35444278fd878a/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:41.074190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c834d1-b230-4fdc-8be5-c5cb5afacd50 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:41.074493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c834d1-b230-4fdc-8be5-c5cb5afacd50 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:41.074745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c834d1-b230-4fdc-8be5-c5cb5afacd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:41.093820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-38c834d1-b230-4fdc-8be5-c5cb5afacd50 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:41.095029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-38c834d1-b230-4fdc-8be5-c5cb5afacd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:41.173447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1328/2652] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:41.183962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:41.186029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:41.201546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:41.244975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a13d2-d79a-497e-a96f-67b9c2b5ca72 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:41.249194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd762ca-2d17-45c8-910d-1e2c2051f039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:41.249819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd762ca-2d17-45c8-910d-1e2c2051f039 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:41.250099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd762ca-2d17-45c8-910d-1e2c2051f039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:41.250350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd762ca-2d17-45c8-910d-1e2c2051f039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:41.259472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd762ca-2d17-45c8-910d-1e2c2051f039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:41.260899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd762ca-2d17-45c8-910d-1e2c2051f039 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:41.270911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1325/2653] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:45.124205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:45.124696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:45.124795 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:45.155420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] MFA Rules not processed for user `06ba7f24fc534ac18c35444278fd878a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:45.156655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:45.231867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1329/2654] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:45.236671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:45.237139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:45.237231 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:45.257057 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] MFA Rules not processed for user `06ba7f24fc534ac18c35444278fd878a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:45.258317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:45.265534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1326/2655] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:45.278553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:45.280127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:45.360880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b53a2-3a19-4c2a-904d-2288d95c1e82 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:45.366817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:45.367468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:45.367745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:45.368012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:45.373179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:45.378775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:45.380769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:45.390702 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1330/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:45.652973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:45.654514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:45.672838 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ad8b4-b3ab-4cf4-b872-082f43fa2c7d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:45.677122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:45.677748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:45.678053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:45.678317 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:45.680378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:45.696957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:45.698455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:45.708287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1327/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:46.069708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:46.071489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:46.148586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bea0e1-3123-4f1c-a0cd-93cf73a957bf service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:46.153879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:46.154485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:46.154756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:46.155019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:46.156963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:46.169219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:46.171160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:46.181477 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1331/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:55.551718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:55.553613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:55.571039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecef88-5615-44ba-959d-e37066d04dc7 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:55.577014 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81379d91-e6ef-4323-a8ff-2d36030ea353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:55.577625 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81379d91-e6ef-4323-a8ff-2d36030ea353 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:55.577915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81379d91-e6ef-4323-a8ff-2d36030ea353 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:55.578186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81379d91-e6ef-4323-a8ff-2d36030ea353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:55.579928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-81379d91-e6ef-4323-a8ff-2d36030ea353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:55.593137 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81379d91-e6ef-4323-a8ff-2d36030ea353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:55.594614 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81379d91-e6ef-4323-a8ff-2d36030ea353 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:55.605850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1328/2659] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:56.177073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=35 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:59.624129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:59.625827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:59.640038 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b374746-83c1-4478-b12f-9ffaf9803cbf service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:59.646391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:59.646995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:59.647264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:59.647524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:59.650004 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:59.663431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:59.665082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:59.675988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1332/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:05.601333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=35 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:09.671323 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:37.181223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a312e93-680d-4699-a3d1-5e22e68e14d0 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:37.181815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a312e93-680d-4699-a3d1-5e22e68e14d0 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:37.181815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a312e93-680d-4699-a3d1-5e22e68e14d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:37.201299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2a312e93-680d-4699-a3d1-5e22e68e14d0 None None] MFA Rules not processed for user `06ba7f24fc534ac18c35444278fd878a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:37.202533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2a312e93-680d-4699-a3d1-5e22e68e14d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:37.209912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1329/2661] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:47.196103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:07.764704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.775169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dca71-f3aa-4dd8-8579-62cf47b042f7 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.778932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.779527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.779797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.780067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.781919 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:07.792040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.793465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.802310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1333/2662] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:17.799260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:21.264048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a312e93-680d-4699-a3d1-5e22e68e14d0 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:21.275986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a312e93-680d-4699-a3d1-5e22e68e14d0 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:21.280298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:21.280896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:21.281169 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:21.281434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:21.283326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:21.298041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:21.299460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:21.312103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1330/2663] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:22.496699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:22.505982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1751-5877-406c-b35d-4b8f38448556 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:22.510192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:22.510792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.511064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.511331 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.513264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:22.528423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:22.529876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:22.541105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1334/2664] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:28.332321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:28.350594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151bae8-3c78-4db2-aae0-ff55bcc67f2e service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:28.358763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:28.359491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:28.359765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:28.360255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:28.362060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:28.375641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:28.377356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:28.390985 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1331/2665] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:32.535860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:33.526639 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.558813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65560739-d6c9-471c-a1bb-e9bf076df152 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.563681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.564310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.564586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.564857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] PATH_INFO: `/v3/users/06ba7f24fc534ac18c35444278fd878a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.566032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ba7f24fc534ac18c35444278fd878a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:33.567973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:33.620860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ba7f24fc534ac18c35444278fd878a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.628407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ba7f24fc534ac18c35444278fd878a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.629146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ba7f24fc534ac18c35444278fd878a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.629780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ba7f24fc534ac18c35444278fd878a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.646355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-275331e3-8b95-42ff-8bf9-4df2b28f6ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ba7f24fc534ac18c35444278fd878a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.662739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1335/2666] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:33 2022] DELETE /identity/v3/users/06ba7f24fc534ac18c35444278fd878a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:33.841431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.852637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44946-3606-4f33-a3ed-da16c9d6246a service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.910980 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.911619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.911892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.912159 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] PATH_INFO: `/v3/projects/c669c4ec0d6e4e7f8bfb9fc64f26735d` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.913328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c669c4ec0d6e4e7f8bfb9fc64f26735d)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:33.915266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:33.962835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c669c4ec0d6e4e7f8bfb9fc64f26735d', 'request_id': 'req-c9fac73c-f379-4234-8fb4-4d2092d6cd94'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.969110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c669c4ec0d6e4e7f8bfb9fc64f26735d', 'request_id': 'req-c9fac73c-f379-4234-8fb4-4d2092d6cd94'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.979141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c669c4ec0d6e4e7f8bfb9fc64f26735d', 'request_id': 'req-c9fac73c-f379-4234-8fb4-4d2092d6cd94'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:34.004333 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] The token cache is being invalidate because project c669c4ec0d6e4e7f8bfb9fc64f26735d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:34.004747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:34.005480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c9fac73c-f379-4234-8fb4-4d2092d6cd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:34.007043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1332/2667] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:33 2022] DELETE /identity/v3/projects/c669c4ec0d6e4e7f8bfb9fc64f26735d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:34.012387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ff1a-d31d-45e5-83df-de9df871444a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.012670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ff1a-d31d-45e5-83df-de9df871444a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.013070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ff1a-d31d-45e5-83df-de9df871444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.033446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d2c9ff1a-d31d-45e5-83df-de9df871444a None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:34.034597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d2c9ff1a-d31d-45e5-83df-de9df871444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:34.093381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1336/2668] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:34.102371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93eec85-0cb8-4620-a37e-80dc1b20508b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.102649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93eec85-0cb8-4620-a37e-80dc1b20508b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.102916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93eec85-0cb8-4620-a37e-80dc1b20508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.125064 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e93eec85-0cb8-4620-a37e-80dc1b20508b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:34.126319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e93eec85-0cb8-4620-a37e-80dc1b20508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:34.136052 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1333/2669] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:34.140528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9ff1a-d31d-45e5-83df-de9df871444a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.151063 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9ff1a-d31d-45e5-83df-de9df871444a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.156480 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.157069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.157448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.157741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.158374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:34.158670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.160263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.172291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1337/2670] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:34.177088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93eec85-0cb8-4620-a37e-80dc1b20508b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.188548 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93eec85-0cb8-4620-a37e-80dc1b20508b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.193776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.194396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.194664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.194915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.195583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.197474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.227215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1334/2671] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:34.232317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.246685 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28064b-6e05-48a9-a559-3cb48ed1f6a9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.290339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:34.308823 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.309421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.309691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.309988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.310595 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.312576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.334199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1338/2672] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:34.338619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.349055 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca3eba-6bb0-4b1e-af29-47d878c848d2 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.354451 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.355040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.355307 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.355568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.356200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.357829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.368091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1335/2673] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:34.372278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.383117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb5965-49e6-49ae-8d70-47984b62f270 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.389668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66dc5-f6ee-4b16-a179-65f040919a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.390294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66dc5-f6ee-4b16-a179-65f040919a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.390555 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66dc5-f6ee-4b16-a179-65f040919a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.390807 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66dc5-f6ee-4b16-a179-65f040919a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.391444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66dc5-f6ee-4b16-a179-65f040919a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.393043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66dc5-f6ee-4b16-a179-65f040919a47 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.533278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1339/2674] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:34.538411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.551988 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c69a-7370-4475-8344-fc083ae78b75 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.557392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.558141 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.558422 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.558692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] PATH_INFO: `/v3/projects/3b5ccc3cc5824d00813a26925dd5e9ef/users/068ce17011aa4e4ebbaad99e412bf954/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.570913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:34.576073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5ccc3cc5824d00813a26925dd5e9ef, user_id=068ce17011aa4e4ebbaad99e412bf954, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.578771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.594628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1336/2675] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:34 2022] PUT /identity/v3/projects/3b5ccc3cc5824d00813a26925dd5e9ef/users/068ce17011aa4e4ebbaad99e412bf954/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:34.600116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8d36-4781-494c-887e-985e85395a71 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.600670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8d36-4781-494c-887e-985e85395a71 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.600670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8d36-4781-494c-887e-985e85395a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.620022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-369e8d36-4781-494c-887e-985e85395a71 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:34.621241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-369e8d36-4781-494c-887e-985e85395a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:34.683929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1340/2676] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:34.695092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.696950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:34.755969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f2fc2-d549-464c-929e-7e38866fdaf1 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.759922 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.760826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.761102 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.761376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.770569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.772354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.782025 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1337/2677] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:38.825841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7181c8-ff32-4602-981a-74fefbd6d540 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:38.826421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7181c8-ff32-4602-981a-74fefbd6d540 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:38.826421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7181c8-ff32-4602-981a-74fefbd6d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:38.857487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bc7181c8-ff32-4602-981a-74fefbd6d540 None None] MFA Rules not processed for user `068ce17011aa4e4ebbaad99e412bf954`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:38.858681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bc7181c8-ff32-4602-981a-74fefbd6d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:38.926959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1341/2678] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:01:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:38.941443 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:38.942975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:39.044050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e017b3-a389-4625-9e30-bf3dedac8b81 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:39.049939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:39.050574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:39.050845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:39.051109 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:39.060406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:39.062063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:39.072039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1338/2679] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:40.468768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f98d0-c5fc-4128-84fd-9aea7838027a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:40.469380 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f98d0-c5fc-4128-84fd-9aea7838027a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:40.469504 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f98d0-c5fc-4128-84fd-9aea7838027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:40.489563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-820f98d0-c5fc-4128-84fd-9aea7838027a None None] MFA Rules not processed for user `068ce17011aa4e4ebbaad99e412bf954`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:40.490787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-820f98d0-c5fc-4128-84fd-9aea7838027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:40.498853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1342/2680] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:01:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:40.844112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:40.854542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a79a3-6131-4d94-85e0-8ad16f06420c service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:40.858754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:40.859361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:40.859644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:40.859913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:40.861763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:40.872666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:40.874186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:40.883329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1339/2681] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:50.484089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:50.879472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:23.691518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:23.692068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:23.692068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:23.711172 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] MFA Rules not processed for user `068ce17011aa4e4ebbaad99e412bf954`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:23.712409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:23.719667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1343/2682] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:33.705710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:59.448079 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.449572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.488193 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dd843-0302-4f53-a520-f190937c7fe7 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.491915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.492541 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.492800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.493047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.494962 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.504508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.506077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.514562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1340/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:59.590641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.592160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.711943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e2837-a369-4096-a228-23dabc4aaaa0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.717495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.718130 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.718399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.718661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.720535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.731733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.733857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.744838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1344/2684] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:59.929566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.939051 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3edcf-a180-447c-a93e-fbb99570a4ce service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.943631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.944227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.944492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.944748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.946862 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.961618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.963127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.974067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1341/2685] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:00.048798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:00.061110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab93f-f5dc-46f3-99ee-c7f3b6cd1a7a service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:00.067221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:00.067810 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:00.068079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:00.068339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:00.070431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:00.082212 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:00.083783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:00.093686 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1345/2686] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:00.437396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:00.439083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:00.454407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182823d3-b155-4442-9867-4e8687f8d150 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:00.460653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:00.461256 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:00.461536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:00.461821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:00.464309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:00.476573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:00.478182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:00.489027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1342/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:07.136679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:07.150415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d827e0-003c-45d6-b5a1-81ddb73c7609 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:07.156858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c367a11-d0c1-446e-bbef-00bcfc7fdc16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:07.157458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c367a11-d0c1-446e-bbef-00bcfc7fdc16 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.157732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c367a11-d0c1-446e-bbef-00bcfc7fdc16 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.158032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c367a11-d0c1-446e-bbef-00bcfc7fdc16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.160091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0c367a11-d0c1-446e-bbef-00bcfc7fdc16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:07.173604 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c367a11-d0c1-446e-bbef-00bcfc7fdc16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:07.175177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c367a11-d0c1-446e-bbef-00bcfc7fdc16 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:07.186151 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1346/2688] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:10.484828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=29 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:16.724397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:16.740880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae0fb2-2e88-4374-b78f-54f670cdf122 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:16.747336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:16.748319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:16.748866 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:16.749782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:16.752881 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:16.766807 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:16.768410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:16.781587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1343/2689] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:17.181392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=66 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:17.548812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:17.549089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:17.549351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:17.569596 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] MFA Rules not processed for user `068ce17011aa4e4ebbaad99e412bf954`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:17.571067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:17.578661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1347/2690] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:26.776060 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:27.564434 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:14.666913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:14.690182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544730-b0f7-48c4-9ee5-bdf0b68c8c8a service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:14.695013 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:14.695612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:14.695885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:14.696179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:14.698133 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:14.708301 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:14.709713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:14.718182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1344/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:24.714559 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:41.922938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.924609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:41.973980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa607649-5970-45d9-bd0c-84f928a7ab89 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.980492 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.981066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.981340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.981631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.989650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.991315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.000353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1348/2692] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:42.209462 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.218618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94c23-2238-45cc-bbbe-30688c2b0819 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.224573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8093480-347f-4319-b6dc-a0c16f5cc5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.225584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8093480-347f-4319-b6dc-a0c16f5cc5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.226318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8093480-347f-4319-b6dc-a0c16f5cc5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.226793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8093480-347f-4319-b6dc-a0c16f5cc5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.231142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b8093480-347f-4319-b6dc-a0c16f5cc5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:42.250134 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8093480-347f-4319-b6dc-a0c16f5cc5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.251651 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8093480-347f-4319-b6dc-a0c16f5cc5b7 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.263494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1345/2693] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:43.447736 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:43.458210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544bbd8-c28f-4137-908d-30f2b176ea74 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:43.462727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:43.463429 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:43.463666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:43.463902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:43.465943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:43.479936 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:43.481399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:43.492520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1349/2694] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:52.258036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:53.487659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=26 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:13.249190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbae86-0d4e-41ec-8905-68c88b9edf39 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.249984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbae86-0d4e-41ec-8905-68c88b9edf39 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.249984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbae86-0d4e-41ec-8905-68c88b9edf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.270994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d5fbae86-0d4e-41ec-8905-68c88b9edf39 None None] MFA Rules not processed for user `068ce17011aa4e4ebbaad99e412bf954`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:13.272209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d5fbae86-0d4e-41ec-8905-68c88b9edf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:13.279530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1346/2695] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:13.628280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:13.638821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746def6-1553-4a8b-9632-5049e419c91d service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:13.645215 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.645828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.646122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.646390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.654922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.656444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.665387 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1350/2696] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:23.265212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:23.661122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:26.213764 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbae86-0d4e-41ec-8905-68c88b9edf39 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:26.226666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbae86-0d4e-41ec-8905-68c88b9edf39 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:26.232247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:26.232854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:26.233154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:26.233387 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:26.235258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:26.248717 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:26.250383 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:26.261642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1347/2697] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:36.256882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:43.428155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.437954 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62200a56-19d6-4a0c-9326-f392206b8805 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.445156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.446112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.446578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.446925 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.449821 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:43.479344 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.480773 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:43.488858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1351/2698] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:53.485619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=11 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:53.454299 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:53.464787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025eeeb-1e02-4aa6-b6f8-e0cad144ef90 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:53.468917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:53.469535 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:53.469817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:53.470073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:53.480070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:53.481420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:53.490723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1348/2699] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:56.714543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:56.727420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513e233-e412-405b-b60e-cbe17773af96 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:56.733447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:56.734091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:56.734364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:56.734629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:56.736441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:56.751008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:56.752665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:56.764528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1352/2700] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:56.779419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:56.797996 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d0e9-25f1-47ad-9daa-908ec5e288b0 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:56.803728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:56.804391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:56.804730 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:56.805140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] PATH_INFO: `/v3/users/068ce17011aa4e4ebbaad99e412bf954` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:56.806486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068ce17011aa4e4ebbaad99e412bf954)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:56.808545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:56.857570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068ce17011aa4e4ebbaad99e412bf954'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:56.858233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068ce17011aa4e4ebbaad99e412bf954'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:56.870280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068ce17011aa4e4ebbaad99e412bf954'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:56.877455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068ce17011aa4e4ebbaad99e412bf954'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:56.878114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-ecdff632-91af-4935-96bc-861cd157de65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068ce17011aa4e4ebbaad99e412bf954'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:56.892389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1349/2701] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:56 2022] DELETE /identity/v3/users/068ce17011aa4e4ebbaad99e412bf954 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:57.072527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.084378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302850-dce4-4726-b9c1-53ba627a552d service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.142927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.143550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.143818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.144213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] PATH_INFO: `/v3/projects/3b5ccc3cc5824d00813a26925dd5e9ef` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.145379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5ccc3cc5824d00813a26925dd5e9ef)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.147327 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.194231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5ccc3cc5824d00813a26925dd5e9ef', 'request_id': 'req-f04f48f1-fd50-4944-9e9e-aa2825619392'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:57.200111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5ccc3cc5824d00813a26925dd5e9ef', 'request_id': 'req-f04f48f1-fd50-4944-9e9e-aa2825619392'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:57.206457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5ccc3cc5824d00813a26925dd5e9ef', 'request_id': 'req-f04f48f1-fd50-4944-9e9e-aa2825619392'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:57.221407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] The token cache is being invalidate because project 3b5ccc3cc5824d00813a26925dd5e9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:57.221690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:57.222461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f04f48f1-fd50-4944-9e9e-aa2825619392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:57.224019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1353/2702] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:57 2022] DELETE /identity/v3/projects/3b5ccc3cc5824d00813a26925dd5e9ef => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:57.229056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aeb95-b588-4ea4-9304-b3dcd396ae6b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.229368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aeb95-b588-4ea4-9304-b3dcd396ae6b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.229636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aeb95-b588-4ea4-9304-b3dcd396ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.289587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-9a1aeb95-b588-4ea4-9304-b3dcd396ae6b None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:57.290850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9a1aeb95-b588-4ea4-9304-b3dcd396ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:57.349936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1350/2703] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:09:57.361129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e30d-3796-4b8d-8602-1cd411a4b0d0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.361407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e30d-3796-4b8d-8602-1cd411a4b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.361815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e30d-3796-4b8d-8602-1cd411a4b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.385193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e8b0e30d-3796-4b8d-8602-1cd411a4b0d0 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:57.386424 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e8b0e30d-3796-4b8d-8602-1cd411a4b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:57.396010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1354/2704] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:57.400341 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aeb95-b588-4ea4-9304-b3dcd396ae6b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.410805 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aeb95-b588-4ea4-9304-b3dcd396ae6b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.416518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.417182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.417456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.417715 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.418389 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:57.418686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.420271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.432428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1351/2705] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:57.436819 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e30d-3796-4b8d-8602-1cd411a4b0d0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.447008 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e30d-3796-4b8d-8602-1cd411a4b0d0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.452551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.453165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.453428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.453683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.454328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.456239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.496419 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1355/2706] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:57 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:57.502763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.513524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87da031-e7b2-4e34-8dae-7e505ca2b142 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.526936 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:57.577271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.577943 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.578215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.578479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.579108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.581032 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.605760 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1352/2707] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:57 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:57.610361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.621007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6db78-cb42-4369-821a-88c3d2674f4f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.625858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.626465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.626730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.626992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.627615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.629324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.639332 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1356/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:57.643772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.654150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fa1e7-7e05-4e98-a60a-b9b68d2026f3 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.659021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8d539-f0ff-4ae2-a8d7-2fb0fd91f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.659632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d539-f0ff-4ae2-a8d7-2fb0fd91f5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.660033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d539-f0ff-4ae2-a8d7-2fb0fd91f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.660273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d539-f0ff-4ae2-a8d7-2fb0fd91f5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.660935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d539-f0ff-4ae2-a8d7-2fb0fd91f5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.662571 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d539-f0ff-4ae2-a8d7-2fb0fd91f5ba admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.673098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1353/2709] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:57.677300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.687388 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac197526-16cf-4963-b36f-68d8e2c87cf5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.694137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.694768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.695039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.695301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] PATH_INFO: `/v3/projects/0d87455bf40b45d8a9091ca970f2aa8f/users/fa5d08b6eaf44ac894905d7c4cce7a45/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.710278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d87455bf40b45d8a9091ca970f2aa8f, user_id=fa5d08b6eaf44ac894905d7c4cce7a45, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.712826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.728453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1357/2710] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:57 2022] PUT /identity/v3/projects/0d87455bf40b45d8a9091ca970f2aa8f/users/fa5d08b6eaf44ac894905d7c4cce7a45/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:57.733587 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0689d-afaa-442d-b3da-31493307986e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.733900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0689d-afaa-442d-b3da-31493307986e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.734160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0689d-afaa-442d-b3da-31493307986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.752913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-74d0689d-afaa-442d-b3da-31493307986e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:57.754180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-74d0689d-afaa-442d-b3da-31493307986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:57.825163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1354/2711] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:57.835748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.837644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:57.844386 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:57.897398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48fecb-cf12-452b-b6db-1009a3f87357 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.901809 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e33f7-689b-4774-af89-0296054de196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.902412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e33f7-689b-4774-af89-0296054de196 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.902683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e33f7-689b-4774-af89-0296054de196 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.902948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e33f7-689b-4774-af89-0296054de196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.912483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e33f7-689b-4774-af89-0296054de196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.913945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e33f7-689b-4774-af89-0296054de196 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.923499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1358/2712] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:02.031719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:02.032758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:02.033038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:02.072900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] MFA Rules not processed for user `fa5d08b6eaf44ac894905d7c4cce7a45`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:02.074194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:02.148891 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1355/2713] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:02.160084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:02.161091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:02.161588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:02.181998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] MFA Rules not processed for user `fa5d08b6eaf44ac894905d7c4cce7a45`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:02.183308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:02.190447 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1359/2714] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:02.202797 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:02.204892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:02.238436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:02.296745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6776ea1-4fdf-4869-83ca-ccda9a791698 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:02.303103 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:02.303877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:02.304147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:02.304410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:02.313053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:02.314790 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:02.325173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1356/2715] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:10:02.947149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:02.948546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:03.032768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319ac52-a044-44e6-a5e5-cb5d7bcb223d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:03.037881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:03.038499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:03.038771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:03.039036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:03.040777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:03.053227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:03.054879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:03.064969 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1360/2716] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:03.596082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:03.597619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:03.616574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee443b-07e8-4f4b-919f-3875f9c72864 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:03.621944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe04ef2-1f82-4488-958a-e710f4dcac04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:03.622946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe04ef2-1f82-4488-958a-e710f4dcac04 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:03.622946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe04ef2-1f82-4488-958a-e710f4dcac04 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:03.623123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe04ef2-1f82-4488-958a-e710f4dcac04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:03.625008 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-bfe04ef2-1f82-4488-958a-e710f4dcac04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:03.637759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe04ef2-1f82-4488-958a-e710f4dcac04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:03.639448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe04ef2-1f82-4488-958a-e710f4dcac04 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:03.650763 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1357/2717] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:10.407592 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:10.409269 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:10.425034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaa027-b9cf-4c24-93ef-a86d10042323 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:10.430463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:10.431088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:10.431359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:10.431622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:10.433312 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:10.445508 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:10.447109 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:10.457573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1361/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:12.508082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a463-1130-4ce8-a9f5-30147de0166e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:12.508617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a463-1130-4ce8-a9f5-30147de0166e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:12.508617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a463-1130-4ce8-a9f5-30147de0166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:12.529220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7d15a463-1130-4ce8-a9f5-30147de0166e None None] MFA Rules not processed for user `fa5d08b6eaf44ac894905d7c4cce7a45`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:12.530515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7d15a463-1130-4ce8-a9f5-30147de0166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:12.538498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1358/2719] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:20.453266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=65 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:22.523228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=32 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:34.147320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.160313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37e194-67f5-4cbc-b86a-f53afbccc563 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.165574 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.166390 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.166659 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.166922 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.168646 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.180674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.182313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.192867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1362/2720] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:34.213656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15a463-1130-4ce8-a9f5-30147de0166e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.228820 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15a463-1130-4ce8-a9f5-30147de0166e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.233839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.234870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.235148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.235411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] PATH_INFO: `/v3/users/fa5d08b6eaf44ac894905d7c4cce7a45` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.236728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5d08b6eaf44ac894905d7c4cce7a45)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.243178 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.296828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5d08b6eaf44ac894905d7c4cce7a45'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.297491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5d08b6eaf44ac894905d7c4cce7a45'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.310453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5d08b6eaf44ac894905d7c4cce7a45'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.317450 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5d08b6eaf44ac894905d7c4cce7a45'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.318214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-58e654a6-48ea-49e4-9e93-f50fd1f02c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5d08b6eaf44ac894905d7c4cce7a45'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.336015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1359/2721] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:34 2022] DELETE /identity/v3/users/fa5d08b6eaf44ac894905d7c4cce7a45 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:34.513111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.527786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e397ba-7d20-4939-b8f1-608c395a6b24 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.584319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.584911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.585178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.585442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] PATH_INFO: `/v3/projects/0d87455bf40b45d8a9091ca970f2aa8f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.586590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d87455bf40b45d8a9091ca970f2aa8f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.588546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.637239 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d87455bf40b45d8a9091ca970f2aa8f', 'request_id': 'req-3a335389-2fe9-4562-b27c-738ed91fe5fc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.643670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d87455bf40b45d8a9091ca970f2aa8f', 'request_id': 'req-3a335389-2fe9-4562-b27c-738ed91fe5fc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.649688 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d87455bf40b45d8a9091ca970f2aa8f', 'request_id': 'req-3a335389-2fe9-4562-b27c-738ed91fe5fc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.663391 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] The token cache is being invalidate because project 0d87455bf40b45d8a9091ca970f2aa8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:34.663679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.664338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3a335389-2fe9-4562-b27c-738ed91fe5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.665902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1363/2722] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:34 2022] DELETE /identity/v3/projects/0d87455bf40b45d8a9091ca970f2aa8f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:34.670923 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf85be9-6a1c-474b-9210-9c345ce7eebf None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.671252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf85be9-6a1c-474b-9210-9c345ce7eebf None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.671524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf85be9-6a1c-474b-9210-9c345ce7eebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.691545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1bf85be9-6a1c-474b-9210-9c345ce7eebf None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:34.692911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1bf85be9-6a1c-474b-9210-9c345ce7eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.751859 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1360/2723] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:34.760628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc3b-89a7-4db6-a8b7-c86471bb6169 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.760968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc3b-89a7-4db6-a8b7-c86471bb6169 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.761369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc3b-89a7-4db6-a8b7-c86471bb6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.785121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7d38cc3b-89a7-4db6-a8b7-c86471bb6169 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:34.786445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7d38cc3b-89a7-4db6-a8b7-c86471bb6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.795315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1364/2724] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:34.799674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf85be9-6a1c-474b-9210-9c345ce7eebf None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.810642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf85be9-6a1c-474b-9210-9c345ce7eebf None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.816619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.817244 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.817518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.817776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.818438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:34.818731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.820319 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.833127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1361/2725] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:34.837598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38cc3b-89a7-4db6-a8b7-c86471bb6169 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.847561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38cc3b-89a7-4db6-a8b7-c86471bb6169 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.852933 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.853519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.853812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.854091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.854711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.856599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.888100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1365/2726] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:34 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:34.892836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.903016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d9d5a-ffa7-4ec1-af86-04de7f8deae6 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.963686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.964672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.964672 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.964965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.965643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.967939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.978524 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:34.995303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1362/2727] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:34 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:34.999431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.011263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e97cd-2a03-4855-ae54-f868a9e5e54c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.017713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.018310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.018573 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.018825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.019446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.021189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.032398 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1366/2728] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:35.037130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.047760 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed95d-25ef-48ad-8ff9-549ac8bd6209 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.053663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e9528-ffed-4a6d-91e8-18678b671657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.054298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e9528-ffed-4a6d-91e8-18678b671657 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.054570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e9528-ffed-4a6d-91e8-18678b671657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.054826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e9528-ffed-4a6d-91e8-18678b671657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.055482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e9528-ffed-4a6d-91e8-18678b671657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.057111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e9528-ffed-4a6d-91e8-18678b671657 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.067916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1363/2729] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:35.072200 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.082089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5672-6302-4cdf-867b-a8b9ee7e857a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.086828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.087575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.087841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.088098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] PATH_INFO: `/v3/projects/153b1badf14f47fdaa5987a26407876f/users/8da4cc55025540be934c14b54d470a7d/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.102497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153b1badf14f47fdaa5987a26407876f, user_id=8da4cc55025540be934c14b54d470a7d, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.105131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.119757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1367/2730] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:35 2022] PUT /identity/v3/projects/153b1badf14f47fdaa5987a26407876f/users/8da4cc55025540be934c14b54d470a7d/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:35.131457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742404f-9106-42d8-903a-32a67d0a829d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.131756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742404f-9106-42d8-903a-32a67d0a829d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.132026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742404f-9106-42d8-903a-32a67d0a829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.161485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5742404f-9106-42d8-903a-32a67d0a829d None None] MFA Rules not processed for user `8da4cc55025540be934c14b54d470a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:35.162744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5742404f-9106-42d8-903a-32a67d0a829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:35.230384 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1364/2731] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:35.240951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.243002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:35.259672 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:35.320624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdcea4-651d-4eef-b786-21ef74523623 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.324648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6cfd-1745-4ae4-8981-5e2e81749072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.325251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6cfd-1745-4ae4-8981-5e2e81749072 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.325520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6cfd-1745-4ae4-8981-5e2e81749072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.325784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6cfd-1745-4ae4-8981-5e2e81749072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.335696 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6cfd-1745-4ae4-8981-5e2e81749072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.337152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6cfd-1745-4ae4-8981-5e2e81749072 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.346838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1368/2732] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:45.227711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:45.342374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=20 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:47.799520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742404f-9106-42d8-903a-32a67d0a829d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:47.861935 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742404f-9106-42d8-903a-32a67d0a829d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:47.866983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:47.867634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:47.867913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:47.868145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] PATH_INFO: `/v3/users/8da4cc55025540be934c14b54d470a7d` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:47.869521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da4cc55025540be934c14b54d470a7d)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:47.871474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:47.922114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da4cc55025540be934c14b54d470a7d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:47.922773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da4cc55025540be934c14b54d470a7d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:47.934329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da4cc55025540be934c14b54d470a7d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:47.940998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da4cc55025540be934c14b54d470a7d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:47.941698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da4cc55025540be934c14b54d470a7d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:47.957773 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1365/2733] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:47 2022] DELETE /identity/v3/users/8da4cc55025540be934c14b54d470a7d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:47.962652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:47.963113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:47.963207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:47.983198 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:47.984430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.045711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1369/2734] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:48.056435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.058078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.117562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162692-629c-448b-9ac4-956c40b010e4 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.121511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66eed0-d1c0-4506-9ada-26a3466e6325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.122146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66eed0-d1c0-4506-9ada-26a3466e6325 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.122420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66eed0-d1c0-4506-9ada-26a3466e6325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.122692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66eed0-d1c0-4506-9ada-26a3466e6325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.131847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66eed0-d1c0-4506-9ada-26a3466e6325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.133273 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66eed0-d1c0-4506-9ada-26a3466e6325 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.143221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1366/2735] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:48.312614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.314079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.328472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786f9a-cd33-414e-a90f-06fb4fc1613c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.334609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.335371 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.335681 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.335946 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] PATH_INFO: `/v3/projects/153b1badf14f47fdaa5987a26407876f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.337536 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=153b1badf14f47fdaa5987a26407876f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.339315 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.389517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153b1badf14f47fdaa5987a26407876f', 'request_id': 'req-b6141d01-53dd-4b9e-837e-5dc31c072e4f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:48.395790 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153b1badf14f47fdaa5987a26407876f', 'request_id': 'req-b6141d01-53dd-4b9e-837e-5dc31c072e4f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:48.401746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153b1badf14f47fdaa5987a26407876f', 'request_id': 'req-b6141d01-53dd-4b9e-837e-5dc31c072e4f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:48.418047 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] The token cache is being invalidate because project 153b1badf14f47fdaa5987a26407876f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:48.418414 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:48.419368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b6141d01-53dd-4b9e-837e-5dc31c072e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:48.421669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1370/2736] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:48 2022] DELETE /identity/v3/projects/153b1badf14f47fdaa5987a26407876f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:48.429156 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e32e2-0362-44f4-b3cc-8233fc5993e5 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.429435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e32e2-0362-44f4-b3cc-8233fc5993e5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.429701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e32e2-0362-44f4-b3cc-8233fc5993e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.452242 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1d7e32e2-0362-44f4-b3cc-8233fc5993e5 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:48.453464 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1d7e32e2-0362-44f4-b3cc-8233fc5993e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.471772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:48.527786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1367/2737] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:48.538583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e0816-239b-423b-aa8c-dbc2ac98ed10 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.538757 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e0816-239b-423b-aa8c-dbc2ac98ed10 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.539046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e0816-239b-423b-aa8c-dbc2ac98ed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.561167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-008e0816-239b-423b-aa8c-dbc2ac98ed10 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:48.562409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-008e0816-239b-423b-aa8c-dbc2ac98ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.572064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1371/2738] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:48.576480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e32e2-0362-44f4-b3cc-8233fc5993e5 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.587000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e32e2-0362-44f4-b3cc-8233fc5993e5 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.592265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.592869 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.593140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.593413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.594099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:48.594400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.595993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.608473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1368/2739] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:48.613083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e0816-239b-423b-aa8c-dbc2ac98ed10 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.624276 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e0816-239b-423b-aa8c-dbc2ac98ed10 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.629777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.630487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.630758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.631021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.631650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.633570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.665149 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1372/2740] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:48 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:48.669584 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.680130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a12403-199e-492c-85ad-468530b02c6c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.737544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.738210 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.738489 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.738752 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.739351 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.741286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.766831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1369/2741] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:48 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:48.771610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.781967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e6ea2-8c39-4395-a39e-229ecf92609c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.787091 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.787709 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.787981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.788244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.788927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.790518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.804272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1373/2742] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:48.810529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.824944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862f0c-601c-44a9-809f-09b8b96e0195 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.833011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fb513-f17a-4d3e-b0fd-39be870e6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.833606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb513-f17a-4d3e-b0fd-39be870e6375 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.833911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb513-f17a-4d3e-b0fd-39be870e6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.834174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb513-f17a-4d3e-b0fd-39be870e6375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.834802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fb513-f17a-4d3e-b0fd-39be870e6375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.836390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fb513-f17a-4d3e-b0fd-39be870e6375 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.847512 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1370/2743] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:48.852019 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.862860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9e06b-8260-4453-927b-6fea32fdb070 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.869113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.869775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.870071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.870334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] PATH_INFO: `/v3/projects/c481909bb24f4acaa180943fc32f9bab/users/1ae0ba3a933c4a2984bf35d739d414bf/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.893253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c481909bb24f4acaa180943fc32f9bab, user_id=1ae0ba3a933c4a2984bf35d739d414bf, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.896219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.913373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1374/2744] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:48 2022] PUT /identity/v3/projects/c481909bb24f4acaa180943fc32f9bab/users/1ae0ba3a933c4a2984bf35d739d414bf/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:48.923613 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298abb-fba6-4d7a-a7a8-25173b44d922 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.923892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298abb-fba6-4d7a-a7a8-25173b44d922 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.924158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298abb-fba6-4d7a-a7a8-25173b44d922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.952519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-16298abb-fba6-4d7a-a7a8-25173b44d922 None None] MFA Rules not processed for user `1ae0ba3a933c4a2984bf35d739d414bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:48.953733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-16298abb-fba6-4d7a-a7a8-25173b44d922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:49.018848 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1371/2745] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:49.029324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:49.031431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:49.053620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:49.090208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11ac44-f1ba-4b87-85d6-de267f047290 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:49.094369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689fc09-5ffa-4821-9568-25f85af762ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:49.094957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689fc09-5ffa-4821-9568-25f85af762ec service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:49.095265 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689fc09-5ffa-4821-9568-25f85af762ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:49.095533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689fc09-5ffa-4821-9568-25f85af762ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:49.104812 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689fc09-5ffa-4821-9568-25f85af762ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:49.106303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689fc09-5ffa-4821-9568-25f85af762ec service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:49.115544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1375/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:53.349067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16298abb-fba6-4d7a-a7a8-25173b44d922 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:53.367990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:53.413425 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16298abb-fba6-4d7a-a7a8-25173b44d922 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:53.418165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:53.418800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:53.419070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:53.419330 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] PATH_INFO: `/v3/users/1ae0ba3a933c4a2984bf35d739d414bf` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:53.420473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae0ba3a933c4a2984bf35d739d414bf)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:53.422416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:53.470438 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae0ba3a933c4a2984bf35d739d414bf'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.471082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae0ba3a933c4a2984bf35d739d414bf'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.482921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae0ba3a933c4a2984bf35d739d414bf'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.490206 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae0ba3a933c4a2984bf35d739d414bf'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.490857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae0ba3a933c4a2984bf35d739d414bf'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.505372 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1372/2747] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:53 2022] DELETE /identity/v3/users/1ae0ba3a933c4a2984bf35d739d414bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:53.510171 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:53.510655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:53.510775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:53.529712 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:53.531093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:53.591122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1376/2748] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:53.601356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:53.602961 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:53.664485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1ca23-9b9d-488a-aba9-aa768a86d28e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:53.669375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c89d10-961a-4178-8195-8b8dcc6d4a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:53.670010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c89d10-961a-4178-8195-8b8dcc6d4a9d service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:53.670282 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c89d10-961a-4178-8195-8b8dcc6d4a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:53.670542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c89d10-961a-4178-8195-8b8dcc6d4a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:53.681245 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c89d10-961a-4178-8195-8b8dcc6d4a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:53.682783 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c89d10-961a-4178-8195-8b8dcc6d4a9d service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:53.692367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1373/2749] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:54.232110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:54.233583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:54.245986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da9c32-800b-4965-aa38-5628e2546109 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:54.251598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:54.252099 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.252613 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.252886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] PATH_INFO: `/v3/projects/c481909bb24f4acaa180943fc32f9bab` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.254066 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c481909bb24f4acaa180943fc32f9bab)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:54.256693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:54.305758 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c481909bb24f4acaa180943fc32f9bab', 'request_id': 'req-5b3cbd7d-5974-4596-a55b-eeeabfd78528'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:54.311864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c481909bb24f4acaa180943fc32f9bab', 'request_id': 'req-5b3cbd7d-5974-4596-a55b-eeeabfd78528'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:54.317322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c481909bb24f4acaa180943fc32f9bab', 'request_id': 'req-5b3cbd7d-5974-4596-a55b-eeeabfd78528'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:54.330748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] The token cache is being invalidate because project c481909bb24f4acaa180943fc32f9bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:54.331024 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:54.331779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5b3cbd7d-5974-4596-a55b-eeeabfd78528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:54.333259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1377/2750] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:54 2022] DELETE /identity/v3/projects/c481909bb24f4acaa180943fc32f9bab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:54.338572 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0205-7a98-4c7c-985b-fabd5920dfbd None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.338855 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0205-7a98-4c7c-985b-fabd5920dfbd None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.339120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0205-7a98-4c7c-985b-fabd5920dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.359360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-889a0205-7a98-4c7c-985b-fabd5920dfbd None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:54.360599 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-889a0205-7a98-4c7c-985b-fabd5920dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:54.395010 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:54.422612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1374/2751] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:54.432521 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac93949-e3c6-42a5-bda5-80fec0d3d094 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.432981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac93949-e3c6-42a5-bda5-80fec0d3d094 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.433321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac93949-e3c6-42a5-bda5-80fec0d3d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.459662 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5ac93949-e3c6-42a5-bda5-80fec0d3d094 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:54.461617 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5ac93949-e3c6-42a5-bda5-80fec0d3d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:54.473537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1378/2752] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:54.478434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a0205-7a98-4c7c-985b-fabd5920dfbd None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:54.489091 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a0205-7a98-4c7c-985b-fabd5920dfbd None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:54.493877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:54.494473 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.494743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.495006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.495637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:54.495925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:54.497513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:54.509241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1375/2753] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:54.513540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac93949-e3c6-42a5-bda5-80fec0d3d094 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:54.523628 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac93949-e3c6-42a5-bda5-80fec0d3d094 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:54.529446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:54.530078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.530348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.530635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.531256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:54.533178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:54.562665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1379/2754] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:54 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:54.567098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:54.577015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d760b-5e65-4c2c-882f-5a78e5c02661 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:54.635946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:54.636561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.636834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.637110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.637738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:54.640050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:54.665252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1376/2755] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:54 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:54.669518 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:54.680138 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e342d86-4bbd-4764-ad8a-fe4394821531 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:54.685251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:54.685882 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.686156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.686418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.687192 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:54.689039 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:54.699584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1380/2756] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:54.703761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:54.714436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7a0f-2c1a-4f2b-9237-79d672622032 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:54.720183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418404-0bb4-4ac7-864c-3b27675ffd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:54.720770 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418404-0bb4-4ac7-864c-3b27675ffd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.721045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418404-0bb4-4ac7-864c-3b27675ffd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.721310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418404-0bb4-4ac7-864c-3b27675ffd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.721990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418404-0bb4-4ac7-864c-3b27675ffd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:54.723576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418404-0bb4-4ac7-864c-3b27675ffd4d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:54.735515 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1377/2757] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:54.740798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:54.751136 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14604c-04b6-4282-a365-a423cc6489b5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:54.756246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:54.756886 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.757157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.757420 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] PATH_INFO: `/v3/projects/6df07e8cc30e4efe8a262743d41b71a0/users/8a3ceadc7d9d4e18a89f60f7f40b923d/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.759861 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:54.777168 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df07e8cc30e4efe8a262743d41b71a0, user_id=8a3ceadc7d9d4e18a89f60f7f40b923d, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:54.779856 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:54.794009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1381/2758] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:54 2022] PUT /identity/v3/projects/6df07e8cc30e4efe8a262743d41b71a0/users/8a3ceadc7d9d4e18a89f60f7f40b923d/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:54.799952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3023-b1a1-4c98-be48-ed4a6310a036 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:54.800239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3023-b1a1-4c98-be48-ed4a6310a036 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:54.800591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3023-b1a1-4c98-be48-ed4a6310a036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:54.946667 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-a0ae3023-b1a1-4c98-be48-ed4a6310a036 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:54.947900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a0ae3023-b1a1-4c98-be48-ed4a6310a036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:55.010448 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1378/2759] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:55.020818 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:55.022967 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:55.080964 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94336-80a6-40ee-b310-0eb12cf6cf5d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:55.084852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:55.085458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:55.085714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:55.086012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:55.095539 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:55.097028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:55.106986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1382/2760] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:59.177098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653e544-991a-4ad9-ba0d-a29ea7873805 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.177616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653e544-991a-4ad9-ba0d-a29ea7873805 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.177616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653e544-991a-4ad9-ba0d-a29ea7873805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.206070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2653e544-991a-4ad9-ba0d-a29ea7873805 None None] MFA Rules not processed for user `8a3ceadc7d9d4e18a89f60f7f40b923d`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:59.207490 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2653e544-991a-4ad9-ba0d-a29ea7873805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:59.244750 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:59.294793 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1379/2761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:10:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:59.299325 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:59.309987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866f693-e2cd-49f6-992c-3740f00dc9cb service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:59.316328 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:59.316973 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.317359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.317634 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.318322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.320250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.351364 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1383/2762] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:59 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:59.355811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653e544-991a-4ad9-ba0d-a29ea7873805 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:59.368978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653e544-991a-4ad9-ba0d-a29ea7873805 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:59.428949 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:59.429571 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.429884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.430148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.430777 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.432692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.457351 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1380/2763] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:59 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:59.461590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:59.472505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f7dc-920b-4d6f-b569-1b0636b032de admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:59.477348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:59.478102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.478372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.478637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.479280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.480902 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.493524 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1384/2764] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:59.498129 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:59.508815 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294a46-cad9-430a-8711-2366aaf53c8c admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:59.513457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:59.514534 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.514804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.515076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] PATH_INFO: `/v3/projects/4e4ec12a4b1c45e59b35be65ccdf5f70/users/7318b7323bdd44488d5b79a2c1eee077/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.531044 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4ec12a4b1c45e59b35be65ccdf5f70, user_id=7318b7323bdd44488d5b79a2c1eee077, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.533674 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.557955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1381/2765] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:59 2022] PUT /identity/v3/projects/4e4ec12a4b1c45e59b35be65ccdf5f70/users/7318b7323bdd44488d5b79a2c1eee077/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:59.559040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:59.570133 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05ca1-3522-4902-b24a-afc351bd7a97 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:59.638108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847097f-4090-447c-903d-b34e660adc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:59.639078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847097f-4090-447c-903d-b34e660adc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.639353 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847097f-4090-447c-903d-b34e660adc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.639618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847097f-4090-447c-903d-b34e660adc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.640253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847097f-4090-447c-903d-b34e660adc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.641898 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847097f-4090-447c-903d-b34e660adc70 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.652693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1385/2766] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:59.656713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:59.667493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b4e8-b377-4727-ace2-37795385c3dd admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:59.672166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:59.672832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.673105 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.673371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] PATH_INFO: `/v3/projects/4e4ec12a4b1c45e59b35be65ccdf5f70/users/7318b7323bdd44488d5b79a2c1eee077/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.675366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4ec12a4b1c45e59b35be65ccdf5f70, user_id=7318b7323bdd44488d5b79a2c1eee077, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.678077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.699007 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1382/2767] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:59 2022] PUT /identity/v3/projects/4e4ec12a4b1c45e59b35be65ccdf5f70/users/7318b7323bdd44488d5b79a2c1eee077/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:11:04.022368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbcc01-ba52-4ef6-a3a0-3df1ecd9bc75 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:04.023242 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbcc01-ba52-4ef6-a3a0-3df1ecd9bc75 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:04.023678 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbcc01-ba52-4ef6-a3a0-3df1ecd9bc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:04.057093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b4cbcc01-ba52-4ef6-a3a0-3df1ecd9bc75 None None] MFA Rules not processed for user `7318b7323bdd44488d5b79a2c1eee077`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:04.058905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b4cbcc01-ba52-4ef6-a3a0-3df1ecd9bc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:04.102461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:04.134715 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1386/2768] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:11:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:04.149360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:04.151445 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:04.227608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbbf62-a9ba-473c-bab7-0534acfe8ddb admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:04.234369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:04.234983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:04.235254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:04.235522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:04.260533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:04.299528 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:04.301293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:04.311000 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1383/2769] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:04.377710 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:04.378338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:04.378472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:04.397258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] MFA Rules not processed for user `8a3ceadc7d9d4e18a89f60f7f40b923d`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:04.398833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:04.410116 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1387/2770] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:11:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:14.306930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=16 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:14.392193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=15 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:14.846362 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:14.908070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5bed6-4d51-450c-a576-21091d8a8cdc service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:14.912211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:14.912811 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:14.913082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:14.913345 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:14.915234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:14.925070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:14.926648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:14.934829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1384/2771] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:17.226527 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:17.228721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:17.317014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ed0d-8b1e-4543-9a52-27d501dfe2ae None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:17.321069 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a188204-9a31-4f78-85da-ffe1d878771d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7c18108a06141b5b501241b919663bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:17.321669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188204-9a31-4f78-85da-ffe1d878771d service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.321974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188204-9a31-4f78-85da-ffe1d878771d service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.322240 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188204-9a31-4f78-85da-ffe1d878771d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.332876 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a188204-9a31-4f78-85da-ffe1d878771d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:17.334433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a188204-9a31-4f78-85da-ffe1d878771d service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:17.344095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1388/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:24.931279 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=26 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:27.339891 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=35 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:42.006049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:42.007699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:42.019138 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e5c45-aa43-4453-bec0-8c4a033a9bfb service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:42.023745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:42.024436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:42.024782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:42.025108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:42.027200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:42.042354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:42.043894 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:42.055465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1385/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:45.479112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6b212-df2d-4383-8c3b-f632d762fc1d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:45.479608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6b212-df2d-4383-8c3b-f632d762fc1d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:45.479719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6b212-df2d-4383-8c3b-f632d762fc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:45.499313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b8d6b212-df2d-4383-8c3b-f632d762fc1d None None] MFA Rules not processed for user `8a3ceadc7d9d4e18a89f60f7f40b923d`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:45.500489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b8d6b212-df2d-4383-8c3b-f632d762fc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:45.511134 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1389/2774] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:46.118397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:46.127554 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cebff-1468-46c8-adc4-8410ce87745f service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:46.131761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087918-2969-4014-8343-7cf90234021c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:46.132388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087918-2969-4014-8343-7cf90234021c service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:46.132660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087918-2969-4014-8343-7cf90234021c service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:46.132909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087918-2969-4014-8343-7cf90234021c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:46.134882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-95087918-2969-4014-8343-7cf90234021c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:46.149830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95087918-2969-4014-8343-7cf90234021c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:46.151266 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95087918-2969-4014-8343-7cf90234021c service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:46.162808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1386/2775] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:55.494566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:56.157786 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:23.639590 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26f74e-a33f-4c05-bf31-3ce08fa16935 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:23.640166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26f74e-a33f-4c05-bf31-3ce08fa16935 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:23.640166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26f74e-a33f-4c05-bf31-3ce08fa16935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:23.662533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4c26f74e-a33f-4c05-bf31-3ce08fa16935 None None] MFA Rules not processed for user `8a3ceadc7d9d4e18a89f60f7f40b923d`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:23.663763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4c26f74e-a33f-4c05-bf31-3ce08fa16935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:23.671843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1390/2776] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:23.951737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087918-2969-4014-8343-7cf90234021c service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:23.962984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087918-2969-4014-8343-7cf90234021c service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:23.967612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:23.968213 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:23.968480 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:23.968744 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:23.970852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:23.981405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:23.982836 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:23.991076 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1387/2777] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:26.835028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26f74e-a33f-4c05-bf31-3ce08fa16935 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:26.849585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26f74e-a33f-4c05-bf31-3ce08fa16935 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:26.856143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:26.856770 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:26.857037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:26.857319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:26.859185 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:26.873618 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:26.875409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:26.887870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1391/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:33.987661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:36.882124 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=9 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:09.084456 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:09.193880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234ea23-b200-4d47-8351-ae3a5b65cec2 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:09.200426 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:09.201061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:09.201328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:09.201591 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] PATH_INFO: `/v3/users/8a3ceadc7d9d4e18a89f60f7f40b923d` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:09.202875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3ceadc7d9d4e18a89f60f7f40b923d)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:09.204775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:09.265217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3ceadc7d9d4e18a89f60f7f40b923d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.265781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3ceadc7d9d4e18a89f60f7f40b923d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.281932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3ceadc7d9d4e18a89f60f7f40b923d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.290305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3ceadc7d9d4e18a89f60f7f40b923d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.291118 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3ceadc7d9d4e18a89f60f7f40b923d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.311538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1388/2779] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:09 2022] DELETE /identity/v3/users/8a3ceadc7d9d4e18a89f60f7f40b923d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:09.496153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:09.508443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8e6d-09b8-4144-a1c1-7674cfa6621b service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:09.569207 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:09.569860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:09.570147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:09.570417 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] PATH_INFO: `/v3/projects/6df07e8cc30e4efe8a262743d41b71a0` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:09.571583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df07e8cc30e4efe8a262743d41b71a0)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:09.573607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:09.623515 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df07e8cc30e4efe8a262743d41b71a0', 'request_id': 'req-2ecef70e-765c-4f08-9eac-915b25df212c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.629674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df07e8cc30e4efe8a262743d41b71a0', 'request_id': 'req-2ecef70e-765c-4f08-9eac-915b25df212c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.636057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df07e8cc30e4efe8a262743d41b71a0', 'request_id': 'req-2ecef70e-765c-4f08-9eac-915b25df212c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.661499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] The token cache is being invalidate because project 6df07e8cc30e4efe8a262743d41b71a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:09.661756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.662457 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.664194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1392/2780] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:09 2022] DELETE /identity/v3/projects/6df07e8cc30e4efe8a262743d41b71a0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:09.668334 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:09.669819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:09.684323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573739da-1e42-4830-bbf4-7250e22a58a2 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:09.743588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:09.744227 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:09.744493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:09.744787 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] PATH_INFO: `/v3/users/7318b7323bdd44488d5b79a2c1eee077` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:09.745972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7318b7323bdd44488d5b79a2c1eee077)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:09.747844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:09.750756 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:09.801066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7318b7323bdd44488d5b79a2c1eee077'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.801766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7318b7323bdd44488d5b79a2c1eee077'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.815196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7318b7323bdd44488d5b79a2c1eee077'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.822434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7318b7323bdd44488d5b79a2c1eee077'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.823252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-f8f33fe4-5611-4feb-be13-e30306625746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7318b7323bdd44488d5b79a2c1eee077'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:09.838616 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1389/2781] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:09 2022] DELETE /identity/v3/users/7318b7323bdd44488d5b79a2c1eee077 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:10.020372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.021870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:10.036346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef70e-765c-4f08-9eac-915b25df212c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.095017 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.095640 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.095909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.096170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] PATH_INFO: `/v3/projects/4e4ec12a4b1c45e59b35be65ccdf5f70` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.097260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4ec12a4b1c45e59b35be65ccdf5f70)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.099219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.121493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:10.147904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4ec12a4b1c45e59b35be65ccdf5f70', 'request_id': 'req-c10f86b1-2bea-413a-9d23-a72d11149ccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:10.154528 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4ec12a4b1c45e59b35be65ccdf5f70', 'request_id': 'req-c10f86b1-2bea-413a-9d23-a72d11149ccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:10.160537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4ec12a4b1c45e59b35be65ccdf5f70', 'request_id': 'req-c10f86b1-2bea-413a-9d23-a72d11149ccb'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:10.175083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] The token cache is being invalidate because project 4e4ec12a4b1c45e59b35be65ccdf5f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:10.175468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:10.175998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c10f86b1-2bea-413a-9d23-a72d11149ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:10.177720 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1393/2782] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:10 2022] DELETE /identity/v3/projects/4e4ec12a4b1c45e59b35be65ccdf5f70 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:10.182857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d8f2-aaa5-41da-b08a-9c6a9ed85bc4 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.183402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d8f2-aaa5-41da-b08a-9c6a9ed85bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.183402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d8f2-aaa5-41da-b08a-9c6a9ed85bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.208769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-3866d8f2-aaa5-41da-b08a-9c6a9ed85bc4 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:10.211058 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3866d8f2-aaa5-41da-b08a-9c6a9ed85bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:10.278036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1390/2783] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:10.286751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff44409-f0dd-4932-9f5a-a1bec88eb008 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.287040 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff44409-f0dd-4932-9f5a-a1bec88eb008 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.287295 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff44409-f0dd-4932-9f5a-a1bec88eb008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.307128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-aff44409-f0dd-4932-9f5a-a1bec88eb008 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:10.308231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-aff44409-f0dd-4932-9f5a-a1bec88eb008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:10.316467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1394/2784] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:10.320967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d8f2-aaa5-41da-b08a-9c6a9ed85bc4 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.331041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d8f2-aaa5-41da-b08a-9c6a9ed85bc4 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.335941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.336568 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.336830 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.337073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] PATH_INFO: `/v3/domains` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.337702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81731) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:10.338158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.339740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.351258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1391/2785] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:10.355733 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff44409-f0dd-4932-9f5a-a1bec88eb008 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.364918 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff44409-f0dd-4932-9f5a-a1bec88eb008 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.370316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.370943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.371326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.371655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.374348 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.404044 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1395/2786] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:10 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:10.408326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.422478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ebd51-0576-426f-98af-9a43f0abb674 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.483309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.483920 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.484194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.484459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.485088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.487155 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.505532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:10.515199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1392/2787] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:10 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:10.520501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.532797 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577d96-1586-4119-a837-b33205358d23 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.538860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.539471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.539726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.539984 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.540625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.542396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.556839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1396/2788] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:10.558386 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.573650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b523b6-0b6f-4d33-b8de-7db7e084412a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.578511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89419978-0433-49d2-933a-2c378ab4f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.579144 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89419978-0433-49d2-933a-2c378ab4f324 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.579424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89419978-0433-49d2-933a-2c378ab4f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.579709 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89419978-0433-49d2-933a-2c378ab4f324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.580357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89419978-0433-49d2-933a-2c378ab4f324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.582001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89419978-0433-49d2-933a-2c378ab4f324 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.592921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1393/2789] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:10.597255 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.607566 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695f78-6aa6-4232-99e3-f692ff0638cb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.613081 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.613730 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.614033 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.614305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] PATH_INFO: `/v3/projects/e950b4609d1e40b892cd7293aed48f73/users/15233182e1b84e92ba98aaf4bca63a98/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.629376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e950b4609d1e40b892cd7293aed48f73, user_id=15233182e1b84e92ba98aaf4bca63a98, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.632068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.647155 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1397/2790] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:10 2022] PUT /identity/v3/projects/e950b4609d1e40b892cd7293aed48f73/users/15233182e1b84e92ba98aaf4bca63a98/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:10.652401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e42ef-d471-421c-b86c-5679253d6e0d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.652685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e42ef-d471-421c-b86c-5679253d6e0d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.652953 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e42ef-d471-421c-b86c-5679253d6e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.673629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f53e42ef-d471-421c-b86c-5679253d6e0d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:10.674887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f53e42ef-d471-421c-b86c-5679253d6e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:10.743546 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1394/2791] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:10.753708 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:10.755608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:10.817446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3488ee-8427-4d2f-adc6-93a48384d23a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:10.824968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:10.825877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:10.826381 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:10.826782 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:10.840987 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:10.842486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:10.852549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1398/2792] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:14.958621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06afc4-7fd0-474f-b751-94e285a5f17f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:14.959140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06afc4-7fd0-474f-b751-94e285a5f17f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:14.959140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06afc4-7fd0-474f-b751-94e285a5f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:14.986633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-ef06afc4-7fd0-474f-b751-94e285a5f17f None None] MFA Rules not processed for user `15233182e1b84e92ba98aaf4bca63a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:14.987800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ef06afc4-7fd0-474f-b751-94e285a5f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:15.051214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1395/2793] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:13:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:15.055630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:15.065474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a73c4e-2824-4acb-b17c-327ead393117 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:15.070241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:15.070949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:15.071283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:15.071619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:15.072487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:15.074600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:15.103264 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1399/2794] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:15 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:15.108958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06afc4-7fd0-474f-b751-94e285a5f17f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:15.119271 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06afc4-7fd0-474f-b751-94e285a5f17f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:15.183704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:15.184321 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:15.184612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:15.184875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:15.185533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:15.187550 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:15.211081 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1396/2795] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:15 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:15.215317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:15.226582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505e5cf-5a9c-4fd9-a23e-fe381a8bf4b9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:15.232740 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:15.233433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:15.233697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:15.233992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:15.234625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:15.236245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:15.247981 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1400/2796] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:15.252436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:15.265510 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfaf80-9d97-4a84-ba99-9152c47cc0e8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:15.270896 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:15.271678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:15.272020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:15.272353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] PATH_INFO: `/v3/projects/ea40ce40fcb743ecb6d1899f8f8bbf82/users/6fd00fb60a624d099aaebfb2ad2f7fac/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:15.274963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:15.290650 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea40ce40fcb743ecb6d1899f8f8bbf82, user_id=6fd00fb60a624d099aaebfb2ad2f7fac, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:15.294982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:15.314208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1397/2797] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:15 2022] PUT /identity/v3/projects/ea40ce40fcb743ecb6d1899f8f8bbf82/users/6fd00fb60a624d099aaebfb2ad2f7fac/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:15.318299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:15.333817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aac01-c4af-4794-bc4b-0b00f586a620 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:15.346512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:15.395430 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809a165-7420-423d-89e9-dbc3c32c17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:15.396046 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a165-7420-423d-89e9-dbc3c32c17b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:15.396320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a165-7420-423d-89e9-dbc3c32c17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:15.396588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a165-7420-423d-89e9-dbc3c32c17b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:15.397249 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809a165-7420-423d-89e9-dbc3c32c17b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:15.398914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809a165-7420-423d-89e9-dbc3c32c17b0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:15.409112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1401/2798] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:15.413284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:15.424543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c4918-366b-49bd-9f14-04d8b87dfe9f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:15.429099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:15.429759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:15.430068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:15.430338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] PATH_INFO: `/v3/projects/ea40ce40fcb743ecb6d1899f8f8bbf82/users/6fd00fb60a624d099aaebfb2ad2f7fac/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:15.432998 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea40ce40fcb743ecb6d1899f8f8bbf82, user_id=6fd00fb60a624d099aaebfb2ad2f7fac, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:15.435656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:15.446366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1398/2799] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:15 2022] PUT /identity/v3/projects/ea40ce40fcb743ecb6d1899f8f8bbf82/users/6fd00fb60a624d099aaebfb2ad2f7fac/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:19.865252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63887a5-9f60-4d77-b64e-0ac1455bcf64 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:19.865738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63887a5-9f60-4d77-b64e-0ac1455bcf64 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:19.870182 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63887a5-9f60-4d77-b64e-0ac1455bcf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:19.906956 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e63887a5-9f60-4d77-b64e-0ac1455bcf64 None None] MFA Rules not processed for user `6fd00fb60a624d099aaebfb2ad2f7fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:19.908227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e63887a5-9f60-4d77-b64e-0ac1455bcf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:19.992499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1402/2800] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:20.006224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:20.008719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:20.107314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36720a8f-2103-4ad5-9ffe-ecb4e9a30b68 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:20.111147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77625f61bca4548af4cd5702d2b807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:20.111761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:20.112029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:20.112294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:20.174877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:20.176270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:20.188698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1399/2801] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:20.419334 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73081e5-a31d-4bd0-af3f-0e4184a74228 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:20.419857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73081e5-a31d-4bd0-af3f-0e4184a74228 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:20.420132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73081e5-a31d-4bd0-af3f-0e4184a74228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:20.491174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c73081e5-a31d-4bd0-af3f-0e4184a74228 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:20.492397 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c73081e5-a31d-4bd0-af3f-0e4184a74228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:20.563783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:20.568629 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1403/2802] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:20.622645 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:20.624066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:20.693736 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:20.723190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34b574-9d90-4ba8-b3d1-2959fabf824d service glance] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:20.728380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d6686-ba0b-4e2b-a674-fa466778f312 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:20.729003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6686-ba0b-4e2b-a674-fa466778f312 service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:20.729281 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6686-ba0b-4e2b-a674-fa466778f312 service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:20.729540 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6686-ba0b-4e2b-a674-fa466778f312 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:20.738398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6686-ba0b-4e2b-a674-fa466778f312 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:20.740050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6686-ba0b-4e2b-a674-fa466778f312 service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:20.748360 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1400/2803] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:13:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:13:29.757606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a77bf-a442-4e2e-b70d-b14c8c9891ad None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:29.758225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a77bf-a442-4e2e-b70d-b14c8c9891ad None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:29.758225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a77bf-a442-4e2e-b70d-b14c8c9891ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:29.778845 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-611a77bf-a442-4e2e-b70d-b14c8c9891ad None None] MFA Rules not processed for user `15233182e1b84e92ba98aaf4bca63a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:29.780050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-611a77bf-a442-4e2e-b70d-b14c8c9891ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:29.787679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1404/2804] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:13:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:30.755822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:31.816918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821933-26e2-49bd-83b7-0ce4454385e5 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:31.817562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821933-26e2-49bd-83b7-0ce4454385e5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:31.817562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821933-26e2-49bd-83b7-0ce4454385e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:31.838890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b0821933-26e2-49bd-83b7-0ce4454385e5 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:31.840047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b0821933-26e2-49bd-83b7-0ce4454385e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:31.847658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1401/2805] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:31.861135 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a77bf-a442-4e2e-b70d-b14c8c9891ad None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:31.872986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a77bf-a442-4e2e-b70d-b14c8c9891ad None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:31.878005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:31.878610 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:31.879545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:31.879545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:31.887963 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:31.889693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:31.898290 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1405/2806] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:13:41.833701 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:41.894669 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=9 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:08.586261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821933-26e2-49bd-83b7-0ce4454385e5 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:08.656068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821933-26e2-49bd-83b7-0ce4454385e5 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:08.660054 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:08.660698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:08.661207 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:08.661478 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:08.672223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:08.673690 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:08.685085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1402/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:10.711559 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:10.714608 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:10.803436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef827dc-00e9-48ab-b76a-b34a652471b4 service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:10.809513 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:10.810279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:10.810635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:10.810961 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:10.812943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:10.826018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:10.827837 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:10.840864 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1406/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:18.679858 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=26 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:20.836541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=34 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:19.017315 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:19.018997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:19.159474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7654d-f511-4651-a7cf-22c8bc3a4202 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:19.166310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:19.166928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:19.167194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:19.167487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:19.169828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:19.182212 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:19.183802 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:19.193972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1403/2809] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:29.189772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=61 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:21.656930 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:21.658625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:21.714100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e4982-b2cf-4871-ac84-ab993f1f2ef8 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:21.718774 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:21.719370 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:21.719615 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:21.719892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:21.721975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:21.733193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:21.734661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:21.743158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1407/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:31.739463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=21 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:07.119860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.133460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc518d04-b600-4c4e-942e-a2a95fc972d0 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.137561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.138188 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.138458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.138721 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.141278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:07.182073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.184186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.205951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1404/2811] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:07.653352 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.679955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad308e-d073-4b0c-9242-a1dde91a40ae service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.690433 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.690907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.691485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.691485 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.693129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:07.709336 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.712471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.724471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1408/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:08.824286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:08.825718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:08.892963 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1c48-38cb-45df-b28a-1f9eca7b7018 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:08.897698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346b12-b62b-4d0a-91d4-aae140518ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7c18108a06141b5b501241b919663bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:08.898357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346b12-b62b-4d0a-91d4-aae140518ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:08.898771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346b12-b62b-4d0a-91d4-aae140518ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:08.899040 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346b12-b62b-4d0a-91d4-aae140518ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:08.901019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dc346b12-b62b-4d0a-91d4-aae140518ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:08.915608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346b12-b62b-4d0a-91d4-aae140518ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:08.917034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346b12-b62b-4d0a-91d4-aae140518ed3 service cinder] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:08.933974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1405/2813] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:17.719580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=8 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:18.925028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=46 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:20.088061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:20.099317 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7583-f419-4e01-9102-42527f38652e service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:20.104175 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:20.104766 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:20.105034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:20.105359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:20.114599 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:20.116043 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:20.125113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1409/2814] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:22.767088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554998d0-6535-453f-bfb5-8127e1af3fd6 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:22.767573 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554998d0-6535-453f-bfb5-8127e1af3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:22.767673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554998d0-6535-453f-bfb5-8127e1af3fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:22.789733 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-554998d0-6535-453f-bfb5-8127e1af3fd6 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:22.791453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-554998d0-6535-453f-bfb5-8127e1af3fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:22.800001 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1406/2815] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 30 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:22.841025 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:22.853309 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43847ea-abad-469f-a306-89e6559cf4c4 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:22.860012 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:22.860611 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:22.860916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:22.861178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:22.869497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:22.871208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:22.879401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1410/2816] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:18:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:18:23.422879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9889-feb7-4707-ad17-4e3e2be02074 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:23.423152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9889-feb7-4707-ad17-4e3e2be02074 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:23.423418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9889-feb7-4707-ad17-4e3e2be02074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:23.443984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-99bd9889-feb7-4707-ad17-4e3e2be02074 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:23.445177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-99bd9889-feb7-4707-ad17-4e3e2be02074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:23.454192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1407/2817] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:18:23.470460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:23.481718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5581-0792-4333-a62a-9e6a953f860c service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:23.488407 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:23.488997 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:23.489291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:23.489565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:23.498666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:23.500351 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:23.509126 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1411/2818] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:18:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:18:31.873607 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e024-1937-495a-9636-c4b2fe559db2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:31.874147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e024-1937-495a-9636-c4b2fe559db2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:31.874147 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e024-1937-495a-9636-c4b2fe559db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:31.893617 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-9e47e024-1937-495a-9636-c4b2fe559db2 None None] MFA Rules not processed for user `15233182e1b84e92ba98aaf4bca63a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:31.894916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9e47e024-1937-495a-9636-c4b2fe559db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:31.902098 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1408/2819] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:32.190329 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:32.200454 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cf40-bce8-4b13-a35f-eb0ae8d4a7c6 service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:32.204857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55df0-0fb0-4c04-9269-3658a2ffdfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:32.205468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55df0-0fb0-4c04-9269-3658a2ffdfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:32.205747 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55df0-0fb0-4c04-9269-3658a2ffdfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:32.206022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55df0-0fb0-4c04-9269-3658a2ffdfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:32.207988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-96c55df0-0fb0-4c04-9269-3658a2ffdfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:32.218355 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c55df0-0fb0-4c04-9269-3658a2ffdfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:32.219794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c55df0-0fb0-4c04-9269-3658a2ffdfe3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:32.227700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1412/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:32.587884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47e024-1937-495a-9636-c4b2fe559db2 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:32.600507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47e024-1937-495a-9636-c4b2fe559db2 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:32.605873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:32.606597 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:32.606930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:32.607376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:32.612270 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:32.624957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:32.626719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:32.638296 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1409/2821] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:34.024591 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:34.025067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:34.025303 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:34.046786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:34.048021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:34.055411 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1413/2822] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:34.068376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:34.079758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38464-7a3f-4698-a924-2a8cac642910 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:34.084725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:34.085327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:34.085600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:34.085877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:34.094238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:34.095808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:34.105006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1410/2823] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:18:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 10:18:44.041577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=27 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:44.101158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=21 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:50.909655 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:50.911197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:50.927835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af734ae-743b-43d7-9b80-c7d01ddde0e8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:50.934031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:50.934664 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:50.934957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:50.935221 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:50.936982 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:50.949904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:50.951772 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:50.963366 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1414/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:00.958541 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:11.271818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.285545 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0cab-4ac5-4c76-b0c2-8b4f556ba5c1 service swift] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.292240 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546811ea-3ead-4417-983f-628502a377c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.293410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546811ea-3ead-4417-983f-628502a377c0 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.293914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546811ea-3ead-4417-983f-628502a377c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.294410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546811ea-3ead-4417-983f-628502a377c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.305142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546811ea-3ead-4417-983f-628502a377c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.307737 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546811ea-3ead-4417-983f-628502a377c0 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.322434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1411/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:21.315950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:24.935784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:24.937450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:24.952389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1eb1c-0c41-44bf-9078-8d061709021c service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:24.960282 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.961234 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.961675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.962118 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.972073 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.973666 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.984111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1415/2826] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:34.979943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:28.657842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b1aed-5344-4d6d-acd7-f967bc820b17 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:28.658356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b1aed-5344-4d6d-acd7-f967bc820b17 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:28.658356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b1aed-5344-4d6d-acd7-f967bc820b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:28.677868 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-994b1aed-5344-4d6d-acd7-f967bc820b17 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:28.679376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-994b1aed-5344-4d6d-acd7-f967bc820b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:28.686930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1412/2827] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 30 10:21:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:28.728734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:28.743002 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b459551-02e6-418d-a242-b812b0a5bdca service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:28.748425 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:28.749006 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:28.749277 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:28.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:28.760579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:28.762213 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:28.770263 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1416/2828] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:21:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:21:29.168342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b1aed-5344-4d6d-acd7-f967bc820b17 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:29.181555 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b1aed-5344-4d6d-acd7-f967bc820b17 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:29.185911 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:29.186502 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:29.186772 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:29.187037 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:29.250217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:29.251576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:29.264503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1413/2829] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:32.475741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:32.490382 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a85d-5b53-4c04-8650-7cee69018bab service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:32.496246 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:32.497169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:32.497650 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:32.498147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:32.501481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:32.517777 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:32.520147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:32.532625 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1417/2830] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:35.818844 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:35.832293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe2cd-6eac-423d-af81-e6ad3b968eca service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:35.837759 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:35.838472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:35.838813 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:35.839140 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:35.840933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:35.853381 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:35.855041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:35.877612 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1414/2831] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:35.881563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:35.893117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b992f-f206-48a4-8a13-7c616fd77aef service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:35.899050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:35.899870 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:35.900272 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:35.900609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] PATH_INFO: `/v3/users/15233182e1b84e92ba98aaf4bca63a98` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:35.901841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=15233182e1b84e92ba98aaf4bca63a98)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:35.903768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:35.958791 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15233182e1b84e92ba98aaf4bca63a98'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.965852 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15233182e1b84e92ba98aaf4bca63a98'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.966517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15233182e1b84e92ba98aaf4bca63a98'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.967113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15233182e1b84e92ba98aaf4bca63a98'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.979196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15233182e1b84e92ba98aaf4bca63a98'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.993562 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1418/2832] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:21:35 2022] DELETE /identity/v3/users/15233182e1b84e92ba98aaf4bca63a98 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:36.175932 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.189406 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550acfa3-181c-476f-adca-31c18652b1b5 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.254265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.254928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.255191 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.255452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] PATH_INFO: `/v3/projects/e950b4609d1e40b892cd7293aed48f73` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.256623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e950b4609d1e40b892cd7293aed48f73)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.258767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.307094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e950b4609d1e40b892cd7293aed48f73', 'request_id': 'req-5ffe2e31-6788-408f-ad10-35b85e32cec5'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.312357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e950b4609d1e40b892cd7293aed48f73', 'request_id': 'req-5ffe2e31-6788-408f-ad10-35b85e32cec5'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.321031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e950b4609d1e40b892cd7293aed48f73', 'request_id': 'req-5ffe2e31-6788-408f-ad10-35b85e32cec5'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.332740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] The token cache is being invalidate because project e950b4609d1e40b892cd7293aed48f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:21:36.333031 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.333658 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.335162 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1415/2833] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:21:36 2022] DELETE /identity/v3/projects/e950b4609d1e40b892cd7293aed48f73 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:36.339285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.340694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:36.354908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485373be-f97b-4dd8-b1ec-7e08fef57fac admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.414505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.415196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.415557 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.415872 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] PATH_INFO: `/v3/users/6fd00fb60a624d099aaebfb2ad2f7fac` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.417129 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd00fb60a624d099aaebfb2ad2f7fac)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.419112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.476488 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd00fb60a624d099aaebfb2ad2f7fac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.477693 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:36.485208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd00fb60a624d099aaebfb2ad2f7fac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.486050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd00fb60a624d099aaebfb2ad2f7fac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.486703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd00fb60a624d099aaebfb2ad2f7fac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.500929 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-22c01469-7fe0-4c81-9754-defdf88662fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd00fb60a624d099aaebfb2ad2f7fac'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.514957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1419/2834] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:21:36 2022] DELETE /identity/v3/users/6fd00fb60a624d099aaebfb2ad2f7fac => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:21:36.699192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.700735 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:36.710283 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:36.714313 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe2e31-6788-408f-ad10-35b85e32cec5 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.780215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.780873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.781148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.781440 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] PATH_INFO: `/v3/projects/ea40ce40fcb743ecb6d1899f8f8bbf82` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.782580 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea40ce40fcb743ecb6d1899f8f8bbf82)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.784466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.832956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea40ce40fcb743ecb6d1899f8f8bbf82', 'request_id': 'req-d975a99d-63b2-420f-a287-a024fa549b0d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.838476 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea40ce40fcb743ecb6d1899f8f8bbf82', 'request_id': 'req-d975a99d-63b2-420f-a287-a024fa549b0d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.847984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea40ce40fcb743ecb6d1899f8f8bbf82', 'request_id': 'req-d975a99d-63b2-420f-a287-a024fa549b0d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.859112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] The token cache is being invalidate because project ea40ce40fcb743ecb6d1899f8f8bbf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:21:36.859392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.860033 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-d975a99d-63b2-420f-a287-a024fa549b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.861547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1416/2835] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:21:36 2022] DELETE /identity/v3/projects/ea40ce40fcb743ecb6d1899f8f8bbf82 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:36.866775 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b3b5-b274-49ed-9718-f67adeeaa4c2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.867059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b3b5-b274-49ed-9718-f67adeeaa4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.867340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b3b5-b274-49ed-9718-f67adeeaa4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.926448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9f90b3b5-b274-49ed-9718-f67adeeaa4c2 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:36.927652 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9f90b3b5-b274-49ed-9718-f67adeeaa4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:36.992644 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1420/2836] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:37.002427 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1c7c-0521-44c1-ac67-40dfff8ca072 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.002754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1c7c-0521-44c1-ac67-40dfff8ca072 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.003019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1c7c-0521-44c1-ac67-40dfff8ca072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.023233 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-635a1c7c-0521-44c1-ac67-40dfff8ca072 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:37.024424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-635a1c7c-0521-44c1-ac67-40dfff8ca072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:37.032782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1417/2837] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:37.037085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b3b5-b274-49ed-9718-f67adeeaa4c2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.047428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b3b5-b274-49ed-9718-f67adeeaa4c2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.052586 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.053177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.053449 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.053711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.054375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:21:37.054670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.056281 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.068649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1421/2838] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:21:37.073184 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a1c7c-0521-44c1-ac67-40dfff8ca072 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.082536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a1c7c-0521-44c1-ac67-40dfff8ca072 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.087446 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.087968 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.088526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.088526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.089116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.091036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.134892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1418/2839] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:21:37 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:37.139497 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.149661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56a225-9c86-465d-8d41-1e14d3d6f76f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.209090 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.209679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.209998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.210260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.210883 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.212806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.235511 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1422/2840] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:21:37 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:37.239723 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.250519 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb00cd-8298-4786-9cfd-46a91e9a7d9a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.255877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.256471 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.256741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.257002 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.257631 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.259257 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.269643 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1419/2841] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:37.273727 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.284463 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f2429-c399-4d69-9463-4aa34d6b3323 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.289097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d56e6-55b6-41d0-8720-a1ab14e75eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.289683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d56e6-55b6-41d0-8720-a1ab14e75eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.289993 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d56e6-55b6-41d0-8720-a1ab14e75eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.290254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d56e6-55b6-41d0-8720-a1ab14e75eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.290879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d56e6-55b6-41d0-8720-a1ab14e75eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.292602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d56e6-55b6-41d0-8720-a1ab14e75eb4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.298235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:37.304259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1423/2842] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:21:37.308832 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.318941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa32cbf-199b-437e-8733-e1184d20ff10 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.323834 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.324582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.324860 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.325131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] PATH_INFO: `/v3/projects/e6d6c35f45474b459e976b646d068e0f/users/328bab79c18241aaba8075a4fd16dc65/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.341608 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d6c35f45474b459e976b646d068e0f, user_id=328bab79c18241aaba8075a4fd16dc65, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.344187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.359525 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1420/2843] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:37 2022] PUT /identity/v3/projects/e6d6c35f45474b459e976b646d068e0f/users/328bab79c18241aaba8075a4fd16dc65/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:37.369959 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697902c-3ced-4301-b107-d955fc61ebfc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.370222 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697902c-3ced-4301-b107-d955fc61ebfc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.370514 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697902c-3ced-4301-b107-d955fc61ebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.400753 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5697902c-3ced-4301-b107-d955fc61ebfc None None] MFA Rules not processed for user `328bab79c18241aaba8075a4fd16dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:37.401998 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5697902c-3ced-4301-b107-d955fc61ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:37.479147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1424/2844] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:21:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:37.484289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.515027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:37.553576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b360b3-429a-40aa-b269-b42cad784c57 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.558731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.559327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.559595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.559857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.560455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.562369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.592369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1421/2845] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:21:37 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:37.596635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697902c-3ced-4301-b107-d955fc61ebfc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.609643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697902c-3ced-4301-b107-d955fc61ebfc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.668139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.668763 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.669034 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.669300 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.669972 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.671913 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.694588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1425/2846] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:21:37 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:37.698809 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.709514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3b1e-a9d8-4ed1-baa6-d3d81b605d2d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.715314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.715892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.716182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.716444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.717073 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.718706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.729594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1422/2847] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:37.733732 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.744451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f282061-947b-4076-9afe-c18f624fb0f3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.750350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.751010 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.751285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.751549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] PATH_INFO: `/v3/projects/2960aee4846844698190c7f9e39ddc70/users/c38771478e3b4fbb966f3a346235743b/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.771101 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2960aee4846844698190c7f9e39ddc70, user_id=c38771478e3b4fbb966f3a346235743b, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.773839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.789097 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1426/2848] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:37 2022] PUT /identity/v3/projects/2960aee4846844698190c7f9e39ddc70/users/c38771478e3b4fbb966f3a346235743b/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:37.794130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.804197 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d5fb-d9ba-43b6-ad4c-1a4c69ffeb0d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.860924 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e50c50-80ee-46d7-8564-6052a7756477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.861582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e50c50-80ee-46d7-8564-6052a7756477 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.861698 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e50c50-80ee-46d7-8564-6052a7756477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.862006 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e50c50-80ee-46d7-8564-6052a7756477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.862639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e50c50-80ee-46d7-8564-6052a7756477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.864241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e50c50-80ee-46d7-8564-6052a7756477 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.874392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1423/2849] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:21:37.878622 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.889679 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d867-1c2e-458b-82dd-ad3847e19ae6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.895651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.896298 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.896569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.896828 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] PATH_INFO: `/v3/projects/2960aee4846844698190c7f9e39ddc70/users/c38771478e3b4fbb966f3a346235743b/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.899041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2960aee4846844698190c7f9e39ddc70, user_id=c38771478e3b4fbb966f3a346235743b, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.901867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.913059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1427/2850] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:37 2022] PUT /identity/v3/projects/2960aee4846844698190c7f9e39ddc70/users/c38771478e3b4fbb966f3a346235743b/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:37.924298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.924576 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.924846 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.954946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] MFA Rules not processed for user `c38771478e3b4fbb966f3a346235743b`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:37.956174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:38.027619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1424/2851] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:21:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:38.043147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:38.045062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:38.091695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:38.122160 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff0ff-dc2d-4635-9839-f19379174eaf admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:38.127683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd70b5c-b16f-490d-b125-5d8954d4af84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:38.128268 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd70b5c-b16f-490d-b125-5d8954d4af84 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:38.128537 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd70b5c-b16f-490d-b125-5d8954d4af84 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:38.128808 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd70b5c-b16f-490d-b125-5d8954d4af84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:38.186305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd70b5c-b16f-490d-b125-5d8954d4af84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:38.187917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd70b5c-b16f-490d-b125-5d8954d4af84 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:38.196632 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1428/2852] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:42.294199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:42.295664 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:42.317995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:42.366481 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833472e-10e9-4092-a15c-c89593e27d3e None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:42.370327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:42.370956 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:42.371196 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:42.371486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:42.382123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:42.383854 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:42.394570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1425/2853] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:21:45.150120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74433-9a2a-4e21-859d-02f02d01c86d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:45.150660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74433-9a2a-4e21-859d-02f02d01c86d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:45.150660 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74433-9a2a-4e21-859d-02f02d01c86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:45.171259 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c1e74433-9a2a-4e21-859d-02f02d01c86d None None] MFA Rules not processed for user `328bab79c18241aaba8075a4fd16dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:45.172469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c1e74433-9a2a-4e21-859d-02f02d01c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:45.186280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1429/2854] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:21:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:48.270994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:48.282945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfce2e-80d9-4899-bc57-83d154507c78 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:48.287857 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:48.288632 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:48.288915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:48.289180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:48.291038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:48.301530 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:48.303015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:48.311828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1426/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:55.164392 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=40 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:58.307678 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=29 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:08.079786 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e74433-9a2a-4e21-859d-02f02d01c86d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:08.091174 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e74433-9a2a-4e21-859d-02f02d01c86d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:08.095373 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc46c-3f6c-43e0-b350-0f5452c948df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:08.095950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc46c-3f6c-43e0-b350-0f5452c948df service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:08.096227 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc46c-3f6c-43e0-b350-0f5452c948df service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:08.096487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc46c-3f6c-43e0-b350-0f5452c948df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:08.098585 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-552cc46c-3f6c-43e0-b350-0f5452c948df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:08.113641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc46c-3f6c-43e0-b350-0f5452c948df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:08.115110 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc46c-3f6c-43e0-b350-0f5452c948df service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:08.126916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1430/2856] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:10.051738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:10.053916 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:10.064434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5754c5-aab9-4ff6-b0ee-cd0f786249d5 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:10.068496 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:10.069392 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:10.069718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:10.070075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:10.072048 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:10.086085 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:10.087812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:10.099622 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1427/2857] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:18.121338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:20.095331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:22.832337 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.832825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.833055 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.856368 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] MFA Rules not processed for user `328bab79c18241aaba8075a4fd16dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:22.860180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.871624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1431/2858] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:32.849003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:31.040166 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:31.041827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:31.162391 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb5c8-2c76-4307-9b92-e538b25d2e99 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:31.168817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:31.169420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:31.169694 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:31.169984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:31.171816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:31.183714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:31.185268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:31.201410 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1428/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:41.197318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=50 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:46.882552 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:46.886588 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:46.928589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79178-29ae-4e29-8bc4-78c0a00495f5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:46.934683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914fee-6f05-4fc8-911b-bcde23d625cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:46.935466 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914fee-6f05-4fc8-911b-bcde23d625cb service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:46.935958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914fee-6f05-4fc8-911b-bcde23d625cb service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:46.936314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914fee-6f05-4fc8-911b-bcde23d625cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:46.938444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-53914fee-6f05-4fc8-911b-bcde23d625cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:46.952029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914fee-6f05-4fc8-911b-bcde23d625cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:46.953654 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914fee-6f05-4fc8-911b-bcde23d625cb service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:46.968274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1432/2860] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:49.396265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:49.411986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbbad-70fe-4b0f-a2ed-296b255f52cf service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:49.418536 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfa1a3-6955-4f46-858c-e7f736de4ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:49.419354 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa1a3-6955-4f46-858c-e7f736de4ee0 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:49.419487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa1a3-6955-4f46-858c-e7f736de4ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:49.419705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa1a3-6955-4f46-858c-e7f736de4ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:49.421671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6bdfa1a3-6955-4f46-858c-e7f736de4ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:49.436078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfa1a3-6955-4f46-858c-e7f736de4ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:49.437654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfa1a3-6955-4f46-858c-e7f736de4ee0 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:49.449332 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1429/2861] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:56.962187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=12 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:59.443812 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:59.535584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f1d3-f219-4212-9f87-5198ed6a70f0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:59.536049 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f1d3-f219-4212-9f87-5198ed6a70f0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:59.536245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f1d3-f219-4212-9f87-5198ed6a70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:59.556032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6960f1d3-f219-4212-9f87-5198ed6a70f0 None None] MFA Rules not processed for user `328bab79c18241aaba8075a4fd16dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:59.557415 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6960f1d3-f219-4212-9f87-5198ed6a70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:59.565748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1433/2862] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:59.930893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5add4-2a1b-4d81-a56b-cce813c3e515 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:59.931400 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5add4-2a1b-4d81-a56b-cce813c3e515 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:59.931816 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5add4-2a1b-4d81-a56b-cce813c3e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:59.989127 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-98b5add4-2a1b-4d81-a56b-cce813c3e515 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:59.990487 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-98b5add4-2a1b-4d81-a56b-cce813c3e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:59.999214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1430/2863] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 30 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:00.004851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960f1d3-f219-4212-9f87-5198ed6a70f0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:00.017443 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960f1d3-f219-4212-9f87-5198ed6a70f0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:00.023607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:00.024510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:00.024938 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:00.025471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:00.038609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:00.057176 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:00.058783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:00.069899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1434/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:26:00.518704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5add4-2a1b-4d81-a56b-cce813c3e515 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:00.534036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5add4-2a1b-4d81-a56b-cce813c3e515 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:00.540585 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:00.541396 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:00.541741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:00.542110 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:00.544251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:00.558074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:00.560430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:00.572208 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1431/2865] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:08.752178 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:08.766540 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef0eba-5a58-4990-a0c4-53c9f7d79975 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:08.776498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38862c76-45fb-4add-9458-8e6d339b322a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:08.777142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38862c76-45fb-4add-9458-8e6d339b322a service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:08.777413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38862c76-45fb-4add-9458-8e6d339b322a service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:08.777676 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38862c76-45fb-4add-9458-8e6d339b322a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:08.779866 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-38862c76-45fb-4add-9458-8e6d339b322a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:08.797558 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38862c76-45fb-4add-9458-8e6d339b322a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:08.799389 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38862c76-45fb-4add-9458-8e6d339b322a service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:08.811484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1435/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:10.567075 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=19 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:18.806576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=15 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:46.937582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:46.957532 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b17605-7e6c-47e2-82a8-2ce5ae890343 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:46.963405 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea13ae-2c21-4906-b8f1-f72f76f9ef1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:46.964005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea13ae-2c21-4906-b8f1-f72f76f9ef1a service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:46.964306 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea13ae-2c21-4906-b8f1-f72f76f9ef1a service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:46.964566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea13ae-2c21-4906-b8f1-f72f76f9ef1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:46.972092 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea13ae-2c21-4906-b8f1-f72f76f9ef1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:46.973663 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea13ae-2c21-4906-b8f1-f72f76f9ef1a service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:46.982495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1432/2867] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:56.978976 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=9 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:17.758121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3176f-f82c-4ab7-9f25-642bcfa4f1c6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:17.758741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3176f-f82c-4ab7-9f25-642bcfa4f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:17.758741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3176f-f82c-4ab7-9f25-642bcfa4f1c6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:17.760131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1436/2868] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 10:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:27:17.766154 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ac735-3905-469e-b3ec-cbbe9be021a2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:17.766629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ac735-3905-469e-b3ec-cbbe9be021a2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:17.766629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ac735-3905-469e-b3ec-cbbe9be021a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:17.796955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d70ac735-3905-469e-b3ec-cbbe9be021a2 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:17.798189 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d70ac735-3905-469e-b3ec-cbbe9be021a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:17.828346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1433/2869] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:27:17.841572 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3176f-f82c-4ab7-9f25-642bcfa4f1c6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:17.854691 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3176f-f82c-4ab7-9f25-642bcfa4f1c6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:17.858589 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:17.859196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:17.859469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:17.859735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:17.867656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:17.869139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:17.878879 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1437/2870] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:17.982027 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48aa1-6e7d-406b-96c3-e8cb917a531d None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:17.982302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48aa1-6e7d-406b-96c3-e8cb917a531d None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:17.982561 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48aa1-6e7d-406b-96c3-e8cb917a531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:18.024369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-33d48aa1-6e7d-406b-96c3-e8cb917a531d None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:18.025569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-33d48aa1-6e7d-406b-96c3-e8cb917a531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:18.036094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1434/2871] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:18.048489 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:18.050056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:18.065942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5c80-349f-45dc-b54d-88dc7d3e5d7b service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:18.071885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ca311-3cc0-49c4-a351-3c20ef04a8e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:18.072442 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca311-3cc0-49c4-a351-3c20ef04a8e2 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:18.072711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca311-3cc0-49c4-a351-3c20ef04a8e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:18.072974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca311-3cc0-49c4-a351-3c20ef04a8e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:18.081248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ca311-3cc0-49c4-a351-3c20ef04a8e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:18.082834 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ca311-3cc0-49c4-a351-3c20ef04a8e2 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:18.092630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1438/2872] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:18.286327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d48aa1-6e7d-406b-96c3-e8cb917a531d None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:18.296253 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d48aa1-6e7d-406b-96c3-e8cb917a531d None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:18.300742 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:18.301338 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:18.301966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:18.301966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:18.304066 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:18.319335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:18.320769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:18.332278 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1435/2873] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:18.393469 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeba4c-c98a-4bb4-8132-c82e2087011f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:18.393748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeba4c-c98a-4bb4-8132-c82e2087011f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:18.394083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeba4c-c98a-4bb4-8132-c82e2087011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:18.415482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-95eeba4c-c98a-4bb4-8132-c82e2087011f None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:18.416694 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-95eeba4c-c98a-4bb4-8132-c82e2087011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:18.426532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1439/2874] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:27:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:18.439194 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:18.455324 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884691-fb4c-48ed-989a-4e451c9647b4 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:18.464634 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:18.465255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:18.465529 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:18.465754 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:18.475444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:18.477015 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:18.487741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1436/2875] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:19.510318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a687-e35a-4dee-9773-60ab26e55f22 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:19.510885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a687-e35a-4dee-9773-60ab26e55f22 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:19.510885 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a687-e35a-4dee-9773-60ab26e55f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:19.532107 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-89c7a687-e35a-4dee-9773-60ab26e55f22 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:19.533319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-89c7a687-e35a-4dee-9773-60ab26e55f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:19.541302 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1440/2876] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 30 10:27:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:19.547741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:19.558388 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6c8e2-c922-464c-a628-fa396e271838 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:19.562340 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:19.562934 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:19.563203 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:19.563465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:19.570950 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:19.572457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:19.580459 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1437/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:29.526713 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=18 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:29.576981 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=42 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:27.162600 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a687-e35a-4dee-9773-60ab26e55f22 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:27.178684 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a687-e35a-4dee-9773-60ab26e55f22 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:27.185127 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:27.185760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:27.186077 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:27.186340 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:27.209062 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:27.210580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:27.235179 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1441/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:28.441424 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:28.458455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fde0c0-aab8-49fc-bebf-05c320830908 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:28.462727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:28.463325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:28.463574 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:28.463822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:28.475268 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:28.476675 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:28.487937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1438/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:33.760320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:33.772544 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d3309-fbdf-45c6-9308-79a501fc46f0 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:33.778724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0fc5-800d-450a-9724-6205d6426005 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:33.779817 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0fc5-800d-450a-9724-6205d6426005 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:33.780156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0fc5-800d-450a-9724-6205d6426005 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:33.780561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0fc5-800d-450a-9724-6205d6426005 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:33.782474 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1f5f0fc5-800d-450a-9724-6205d6426005 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:33.803549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f0fc5-800d-450a-9724-6205d6426005 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:33.805102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f0fc5-800d-450a-9724-6205d6426005 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:33.816690 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1442/2880] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:38.130959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:38.139507 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dcd2b-818b-4af6-b7b3-3339f28c1639 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:38.143356 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6d855-a60f-4452-ab50-4fb10553e99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:38.143942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d855-a60f-4452-ab50-4fb10553e99f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:38.144209 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d855-a60f-4452-ab50-4fb10553e99f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:38.144472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d855-a60f-4452-ab50-4fb10553e99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:38.154411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6d855-a60f-4452-ab50-4fb10553e99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:38.155818 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6d855-a60f-4452-ab50-4fb10553e99f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:38.165885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1439/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:40.712007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fea91-2ad2-403f-876c-3a360e37ed73 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:40.712481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fea91-2ad2-403f-876c-3a360e37ed73 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:40.712580 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fea91-2ad2-403f-876c-3a360e37ed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:40.739661 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-135fea91-2ad2-403f-876c-3a360e37ed73 None None] MFA Rules not processed for user `328bab79c18241aaba8075a4fd16dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:40.741667 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-135fea91-2ad2-403f-876c-3a360e37ed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:40.750862 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1443/2882] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:28:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:28:42.475272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204b13-3b1e-4b49-a678-625228b7ce91 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:42.475729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204b13-3b1e-4b49-a678-625228b7ce91 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:42.475835 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204b13-3b1e-4b49-a678-625228b7ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:42.496942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-2f204b13-3b1e-4b49-a678-625228b7ce91 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:42.498238 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-2f204b13-3b1e-4b49-a678-625228b7ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:42.507323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1440/2883] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:42.519739 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fea91-2ad2-403f-876c-3a360e37ed73 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:42.532788 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fea91-2ad2-403f-876c-3a360e37ed73 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:42.540413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:42.541096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:42.541367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:42.541813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:42.551742 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:42.553384 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:42.563917 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1444/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:52.491942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=17 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:52.559506 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=30 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:38.995019 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204b13-3b1e-4b49-a678-625228b7ce91 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:39.006738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204b13-3b1e-4b49-a678-625228b7ce91 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:39.013457 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:39.014100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:39.014369 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:39.014629 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:39.024272 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:39.026251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:39.036769 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1441/2885] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:49.032482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:11.473707 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:11.491258 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164a57-39e0-4b72-928c-0930a674943d service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:11.497146 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac836f87-2553-44e3-8a9d-ef9652d02ba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:11.497926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac836f87-2553-44e3-8a9d-ef9652d02ba9 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:11.498204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac836f87-2553-44e3-8a9d-ef9652d02ba9 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:11.498607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac836f87-2553-44e3-8a9d-ef9652d02ba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:11.508546 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac836f87-2553-44e3-8a9d-ef9652d02ba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:11.510496 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac836f87-2553-44e3-8a9d-ef9652d02ba9 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:11.523166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1445/2886] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:18.304111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:18.315586 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcd4c3-f4d0-4e10-b863-997210fd3f83 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:18.321382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:18.322026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:18.322285 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:18.322565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:18.324486 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:18.336336 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:18.337952 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:18.349435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1442/2887] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:21.517183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:24.153505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03546df-e32a-4c56-a98d-6e720077b666 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:24.154159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03546df-e32a-4c56-a98d-6e720077b666 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:24.154159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03546df-e32a-4c56-a98d-6e720077b666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:24.173711 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d03546df-e32a-4c56-a98d-6e720077b666 None None] MFA Rules not processed for user `328bab79c18241aaba8075a4fd16dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:31:24.174857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d03546df-e32a-4c56-a98d-6e720077b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:24.182199 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1446/2888] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:31:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:31:24.531562 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:24.542179 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4381be-0ad0-4090-99b1-322567739f02 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:24.546190 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:24.546827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:24.547097 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:24.547357 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:24.549376 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:24.564116 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:24.565776 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:24.575255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1443/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:34.168533 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:34.434367 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03546df-e32a-4c56-a98d-6e720077b666 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:34.448999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03546df-e32a-4c56-a98d-6e720077b666 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:34.457060 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749b02-1e09-454d-ac99-9016aae39dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:34.458094 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749b02-1e09-454d-ac99-9016aae39dec service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:34.458460 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749b02-1e09-454d-ac99-9016aae39dec service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:34.458787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749b02-1e09-454d-ac99-9016aae39dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:34.469577 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749b02-1e09-454d-ac99-9016aae39dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:34.471278 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749b02-1e09-454d-ac99-9016aae39dec service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:34.484597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1447/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:34.570959 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:38.770583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:38.772414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:38.882850 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc21f0-a9f6-496f-87c0-5bba7aa18b32 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:38.889847 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:38.890216 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:38.890458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:38.890861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:38.900775 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:38.902430 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:38.913605 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1444/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:39.971651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6a39-dadc-4ea5-a731-0589588fcf03 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:39.972210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6a39-dadc-4ea5-a731-0589588fcf03 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:39.972210 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6a39-dadc-4ea5-a731-0589588fcf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:40.002911 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d6aa6a39-dadc-4ea5-a731-0589588fcf03 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:31:40.004111 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d6aa6a39-dadc-4ea5-a731-0589588fcf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:40.013203 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1448/2892] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Sep 30 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:31:40.026828 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:40.039582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5468d8-cdbc-4048-a315-6e8b160a0115 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:40.046610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:40.047246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:40.047513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:40.047771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:40.057380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:40.058973 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:40.069303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1445/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:49.998114 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=13 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:50.065173 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=45 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:10.279018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa6a39-dadc-4ea5-a731-0589588fcf03 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:10.292313 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa6a39-dadc-4ea5-a731-0589588fcf03 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:10.299123 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:10.300014 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:10.300291 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:10.300554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:10.302647 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:10.385120 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:10.386751 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:10.407418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1449/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:32:20.404569 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=41 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:36.650056 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:36.707668 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524af31-6706-4f4b-be19-c0a3d5890390 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:36.711503 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d02b4-3490-4a5e-a758-581fca095fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:36.712100 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d02b4-3490-4a5e-a758-581fca095fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:36.712367 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d02b4-3490-4a5e-a758-581fca095fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:36.712621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d02b4-3490-4a5e-a758-581fca095fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:36.714582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4c2d02b4-3490-4a5e-a758-581fca095fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:36.738758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d02b4-3490-4a5e-a758-581fca095fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:36.740917 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d02b4-3490-4a5e-a758-581fca095fcf service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:36.748875 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1446/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:32:46.745247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=31 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:56.291890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:56.293606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:56.388465 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8316482-08ad-456c-aac1-a183d4862d6d service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:56.393598 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:56.394229 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:56.394501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:56.394765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] PATH_INFO: `/v3/users/328bab79c18241aaba8075a4fd16dc65` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:56.395950 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328bab79c18241aaba8075a4fd16dc65)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:56.397907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:56.456022 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328bab79c18241aaba8075a4fd16dc65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.463326 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328bab79c18241aaba8075a4fd16dc65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.464102 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328bab79c18241aaba8075a4fd16dc65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.464853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328bab79c18241aaba8075a4fd16dc65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.477926 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328bab79c18241aaba8075a4fd16dc65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.493350 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1450/2896] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:32:56 2022] DELETE /identity/v3/users/328bab79c18241aaba8075a4fd16dc65 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:56.498415 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:56.498930 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:56.499036 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:56.528153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:32:56.529366 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:56.591240 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1447/2897] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:32:56.601378 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:56.602935 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:56.662939 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1298fd-8f7f-4ae2-878c-6cbb9b0c8081 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:56.667106 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:56.667700 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:56.667968 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:56.668228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:56.674122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:56.678627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:56.680090 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:56.691193 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1451/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:32:56.871454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:56.872977 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:56.905049 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c39db7-ae3a-4193-94a6-2476c1b5996c None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:56.910248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:56.910884 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:56.911150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:56.911412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] PATH_INFO: `/v3/projects/e6d6c35f45474b459e976b646d068e0f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:56.912527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d6c35f45474b459e976b646d068e0f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:56.914465 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:56.964582 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d6c35f45474b459e976b646d068e0f', 'request_id': 'req-0b3498c3-6829-45a8-91d8-449f540ee12d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.971394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d6c35f45474b459e976b646d068e0f', 'request_id': 'req-0b3498c3-6829-45a8-91d8-449f540ee12d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.979647 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d6c35f45474b459e976b646d068e0f', 'request_id': 'req-0b3498c3-6829-45a8-91d8-449f540ee12d'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.990641 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] The token cache is being invalidate because project e6d6c35f45474b459e976b646d068e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:32:56.990958 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.991685 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:56.993241 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1448/2899] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:32:56 2022] DELETE /identity/v3/projects/e6d6c35f45474b459e976b646d068e0f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:56.997668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:57.007621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47bc7c-8112-4364-902d-c82aef57392d service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:57.067475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:57.068095 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:57.068359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:57.068624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] PATH_INFO: `/v3/users/c38771478e3b4fbb966f3a346235743b` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:57.082037 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38771478e3b4fbb966f3a346235743b)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:57.083991 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:57.142471 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38771478e3b4fbb966f3a346235743b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.152704 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38771478e3b4fbb966f3a346235743b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.153374 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38771478e3b4fbb966f3a346235743b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.154001 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38771478e3b4fbb966f3a346235743b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.166945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2ec9befa-efcd-4bc3-9c33-87b6a8356268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38771478e3b4fbb966f3a346235743b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.182798 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1452/2900] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:32:56 2022] DELETE /identity/v3/users/c38771478e3b4fbb966f3a346235743b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:57.471704 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:57.473160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:57.487236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3498c3-6829-45a8-91d8-449f540ee12d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:57.551142 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:57.551873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:57.552041 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:57.552305 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] PATH_INFO: `/v3/projects/2960aee4846844698190c7f9e39ddc70` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:57.563409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2960aee4846844698190c7f9e39ddc70)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:57.565346 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:57.576234 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:57.613740 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2960aee4846844698190c7f9e39ddc70', 'request_id': 'req-c53c9c05-bbed-4a5b-946a-de6f397eb584'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.619778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2960aee4846844698190c7f9e39ddc70', 'request_id': 'req-c53c9c05-bbed-4a5b-946a-de6f397eb584'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.628885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2960aee4846844698190c7f9e39ddc70', 'request_id': 'req-c53c9c05-bbed-4a5b-946a-de6f397eb584'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.642221 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] The token cache is being invalidate because project 2960aee4846844698190c7f9e39ddc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:32:57.642497 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.643146 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-c53c9c05-bbed-4a5b-946a-de6f397eb584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:57.644637 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1449/2901] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:32:57 2022] DELETE /identity/v3/projects/2960aee4846844698190c7f9e39ddc70 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:57.650224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46d90-37b8-453e-b07c-7ba15b41224e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:57.650745 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46d90-37b8-453e-b07c-7ba15b41224e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:57.651228 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46d90-37b8-453e-b07c-7ba15b41224e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:57.697237 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e7d46d90-37b8-453e-b07c-7ba15b41224e None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:32:57.698479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e7d46d90-37b8-453e-b07c-7ba15b41224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:57.741995 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:57.762148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1453/2902] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:32:57.771630 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce27ef-b254-4751-a379-5a940a15a98f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:57.771995 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce27ef-b254-4751-a379-5a940a15a98f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:57.772328 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce27ef-b254-4751-a379-5a940a15a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:57.794070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-fbce27ef-b254-4751-a379-5a940a15a98f None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:32:57.795289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fbce27ef-b254-4751-a379-5a940a15a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:57.804287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1450/2903] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:32:57.808805 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46d90-37b8-453e-b07c-7ba15b41224e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:57.819253 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46d90-37b8-453e-b07c-7ba15b41224e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:57.824475 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:57.825071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:57.825345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:57.825607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:57.826306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:32:57.826609 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:57.828208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:57.841406 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1454/2904] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:32:57.847570 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce27ef-b254-4751-a379-5a940a15a98f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:57.858666 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce27ef-b254-4751-a379-5a940a15a98f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:57.863987 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:57.864610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:57.864867 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:57.865145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:57.865821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:57.867699 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:57.914870 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1451/2905] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:32:57 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:32:57.916139 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:57.926520 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1f34-24dd-4e88-af1e-c5ade1daf7cd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:57.983306 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:57.983904 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:57.984177 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:57.984448 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:57.985065 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:57.987023 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:58.013005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1455/2906] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:32:57 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:32:58.017428 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:58.028697 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47ad9-894b-41c4-9acb-34ee8e89f039 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:58.034395 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:58.035011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:58.035277 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:58.035547 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:58.036175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:58.037746 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:58.048310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1452/2907] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:32:58.052483 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:58.063379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39fcd-defa-4650-b31d-37660d543041 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:58.068490 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e742ae-b3fb-40e8-a42b-164d2dac97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:58.069085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e742ae-b3fb-40e8-a42b-164d2dac97c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:58.069363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e742ae-b3fb-40e8-a42b-164d2dac97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:58.069645 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e742ae-b3fb-40e8-a42b-164d2dac97c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:58.070301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e742ae-b3fb-40e8-a42b-164d2dac97c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:58.071877 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e742ae-b3fb-40e8-a42b-164d2dac97c4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:58.082648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1456/2908] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:32:58.088842 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:58.104293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c7fc-ea56-402b-a9a8-dda46ae2f423 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:58.111065 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:58.111718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:58.111994 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:58.112262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] PATH_INFO: `/v3/projects/ec599e66d93148cf8017b758fe4d314f/users/56ec8e1b39f34df7a5ec433682772c5c/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:58.127937 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec599e66d93148cf8017b758fe4d314f, user_id=56ec8e1b39f34df7a5ec433682772c5c, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:58.130610 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:58.147544 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1453/2909] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:32:58 2022] PUT /identity/v3/projects/ec599e66d93148cf8017b758fe4d314f/users/56ec8e1b39f34df7a5ec433682772c5c/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:58.154493 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4461a-81fc-493f-944a-5f8c7324a37d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:58.154768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4461a-81fc-493f-944a-5f8c7324a37d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:58.155058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4461a-81fc-493f-944a-5f8c7324a37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:58.174285 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7ef4461a-81fc-493f-944a-5f8c7324a37d None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:32:58.175484 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7ef4461a-81fc-493f-944a-5f8c7324a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:58.237549 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1457/2910] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:32:58.251160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:58.253077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:58.313639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6846-891c-45cd-a26d-18bebeb07233 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:58.318029 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:58.318635 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:58.318900 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:58.319182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:58.330020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:58.332222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:58.348132 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1454/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:02.612806 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f91002-4cb7-4bc7-9d04-9c5cc2ecb008 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:02.613409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f91002-4cb7-4bc7-9d04-9c5cc2ecb008 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:02.613409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f91002-4cb7-4bc7-9d04-9c5cc2ecb008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:02.642131 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c0f91002-4cb7-4bc7-9d04-9c5cc2ecb008 None None] MFA Rules not processed for user `56ec8e1b39f34df7a5ec433682772c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:02.643356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c0f91002-4cb7-4bc7-9d04-9c5cc2ecb008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:02.690718 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:02.715767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1458/2912] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:02.720339 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:02.730222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba279b-2762-414a-9858-6de3718f5b9d service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:02.735123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:02.735718 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:02.735989 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:02.736254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:02.736889 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:02.738837 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:02.767026 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1455/2913] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:33:02 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:33:02.773144 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f91002-4cb7-4bc7-9d04-9c5cc2ecb008 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:02.788576 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f91002-4cb7-4bc7-9d04-9c5cc2ecb008 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:02.846971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:02.847512 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:02.847783 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:02.848067 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:02.848697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:02.850734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:02.876424 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1459/2914] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:33:02 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:33:02.877712 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:02.889514 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afd7e0-3ff7-4fac-b661-26a7537d796d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:02.895725 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:02.896548 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:02.896927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:02.897556 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:02.898390 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:02.900072 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:02.902182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:02.913941 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1456/2915] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:02.918401 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:02.930079 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc198f-5aa7-4bc2-9f52-1c5e34e62426 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:02.935088 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:02.935932 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:02.936472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:02.936878 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] PATH_INFO: `/v3/projects/fe8a620a8c3b4f9a96e1dbfc5cc09b96/users/e8d6d5dbbd2244059b160ffebc3bc51a/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:02.955125 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8a620a8c3b4f9a96e1dbfc5cc09b96, user_id=e8d6d5dbbd2244059b160ffebc3bc51a, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:02.957789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:02.973356 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1460/2916] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:33:02 2022] PUT /identity/v3/projects/fe8a620a8c3b4f9a96e1dbfc5cc09b96/users/e8d6d5dbbd2244059b160ffebc3bc51a/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:02.977434 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:02.989046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5171f-62cc-4762-bff4-6d1b481ddd9f admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:03.051177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ac57-cf3d-4d10-80dc-7ab418f47fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:03.051945 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ac57-cf3d-4d10-80dc-7ab418f47fea admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:03.052224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ac57-cf3d-4d10-80dc-7ab418f47fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:03.052492 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ac57-cf3d-4d10-80dc-7ab418f47fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:03.055435 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ac57-cf3d-4d10-80dc-7ab418f47fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:03.057067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ac57-cf3d-4d10-80dc-7ab418f47fea admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:03.068508 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1457/2917] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:03.072619 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:03.083501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1e9fb-62b6-4038-87b9-b299912e654a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:03.089280 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:03.089985 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:03.090256 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:03.090689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] PATH_INFO: `/v3/projects/fe8a620a8c3b4f9a96e1dbfc5cc09b96/users/e8d6d5dbbd2244059b160ffebc3bc51a/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:03.092665 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8a620a8c3b4f9a96e1dbfc5cc09b96, user_id=e8d6d5dbbd2244059b160ffebc3bc51a, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:03.095375 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:03.107677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1461/2918] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:33:03 2022] PUT /identity/v3/projects/fe8a620a8c3b4f9a96e1dbfc5cc09b96/users/e8d6d5dbbd2244059b160ffebc3bc51a/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:07.784449 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af327-c67a-4394-8245-aa9168db9506 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:07.785711 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af327-c67a-4394-8245-aa9168db9506 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:07.786458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af327-c67a-4394-8245-aa9168db9506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:07.823909 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-573af327-c67a-4394-8245-aa9168db9506 None None] MFA Rules not processed for user `e8d6d5dbbd2244059b160ffebc3bc51a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:07.825877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-573af327-c67a-4394-8245-aa9168db9506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:07.894681 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1458/2919] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:07.911741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:07.914822 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:07.997725 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d28d-81dd-4bbb-9851-9fd5c51d72de admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:08.003446 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8266fc-2f92-40d9-b73b-efb095493887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:08.004064 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8266fc-2f92-40d9-b73b-efb095493887 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:08.004335 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8266fc-2f92-40d9-b73b-efb095493887 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:08.004597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8266fc-2f92-40d9-b73b-efb095493887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:08.037571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:08.065565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8266fc-2f92-40d9-b73b-efb095493887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:08.067156 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8266fc-2f92-40d9-b73b-efb095493887 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:08.076319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1462/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:09.093182 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97237-a849-4620-aa7e-9ec1e2364c6a None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:09.093682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97237-a849-4620-aa7e-9ec1e2364c6a None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:09.093780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97237-a849-4620-aa7e-9ec1e2364c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:09.115538 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e5b97237-a849-4620-aa7e-9ec1e2364c6a None None] MFA Rules not processed for user `56ec8e1b39f34df7a5ec433682772c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:09.117038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e5b97237-a849-4620-aa7e-9ec1e2364c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:09.124035 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1459/2921] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:14.246714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1366143-4993-4db4-843b-b2b116088d25 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:14.247445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1366143-4993-4db4-843b-b2b116088d25 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:14.247445 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1366143-4993-4db4-843b-b2b116088d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:14.288121 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a1366143-4993-4db4-843b-b2b116088d25 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:14.289339 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a1366143-4993-4db4-843b-b2b116088d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:14.300737 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1463/2922] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:19.109890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=68 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:24.285494 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=22 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:25.062151 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e2f4-466d-48a4-be96-a348ff7b106c None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:25.062689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e2f4-466d-48a4-be96-a348ff7b106c None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:25.062689 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e2f4-466d-48a4-be96-a348ff7b106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:25.087669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-4a49e2f4-466d-48a4-be96-a348ff7b106c None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:25.088885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4a49e2f4-466d-48a4-be96-a348ff7b106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:25.100084 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1460/2923] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:25.243641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1366143-4993-4db4-843b-b2b116088d25 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:25.306996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1366143-4993-4db4-843b-b2b116088d25 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:25.312180 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:25.312787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:25.313059 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:25.313318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:25.324098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:25.325584 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:25.335304 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1464/2924] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:35.081187 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:35.331223 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=26 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:39.642967 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d3c9-725c-4399-8901-430110006217 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:39.643569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d3c9-725c-4399-8901-430110006217 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:39.643569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d3c9-725c-4399-8901-430110006217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:39.665639 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-dac8d3c9-725c-4399-8901-430110006217 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:34:39.666925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dac8d3c9-725c-4399-8901-430110006217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:39.674863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1461/2925] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Sep 30 10:34:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:34:39.687784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:39.697152 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0656c-3875-470d-8ad6-d9689ed18f78 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:39.701671 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87871052-47f2-4ec9-be19-9dd4a93fb377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:39.702305 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871052-47f2-4ec9-be19-9dd4a93fb377 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:39.702571 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871052-47f2-4ec9-be19-9dd4a93fb377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:39.702827 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871052-47f2-4ec9-be19-9dd4a93fb377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:39.710565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87871052-47f2-4ec9-be19-9dd4a93fb377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:39.712005 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87871052-47f2-4ec9-be19-9dd4a93fb377 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:39.720362 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1465/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:34:49.659420 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:49.716941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:35:53.135228 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb90598-33ea-46c0-8bc7-3bf3ce2803cf None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:53.136185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb90598-33ea-46c0-8bc7-3bf3ce2803cf None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:53.136185 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb90598-33ea-46c0-8bc7-3bf3ce2803cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:53.159955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-acb90598-33ea-46c0-8bc7-3bf3ce2803cf None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:35:53.161192 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-acb90598-33ea-46c0-8bc7-3bf3ce2803cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:53.191638 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1462/2927] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:35:53.203532 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052e40-412b-4fc2-9f61-abbe72860d01 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:53.203994 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052e40-412b-4fc2-9f61-abbe72860d01 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:53.204100 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a052e40-412b-4fc2-9f61-abbe72860d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:53.254881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0a052e40-412b-4fc2-9f61-abbe72860d01 None None] MFA Rules not processed for user `b77625f61bca4548af4cd5702d2b807a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:35:53.255978 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0a052e40-412b-4fc2-9f61-abbe72860d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:53.329612 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1466/2928] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 30 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:35:53.336094 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb90598-33ea-46c0-8bc7-3bf3ce2803cf None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:35:53.346063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb90598-33ea-46c0-8bc7-3bf3ce2803cf None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:35:53.350258 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77625f61bca4548af4cd5702d2b807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:35:53.350856 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:53.351145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:53.351403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:53.361960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:35:53.363416 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:35:53.374130 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1463/2929] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:35:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:35:53.587630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997df64-6c57-47a4-809e-3e9a677d2644 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:53.587892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997df64-6c57-47a4-809e-3e9a677d2644 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:53.588167 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997df64-6c57-47a4-809e-3e9a677d2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:53.607974 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7997df64-6c57-47a4-809e-3e9a677d2644 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:35:53.609261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7997df64-6c57-47a4-809e-3e9a677d2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:53.619204 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1467/2930] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:35:53.630982 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:35:53.632596 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:53.645551 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39ac05-2903-4b33-832c-2be3a136c38d service glance] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:35:53.649495 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b9c79-7747-4c99-b94d-d62fec384bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:35:53.650111 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9c79-7747-4c99-b94d-d62fec384bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:53.650368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9c79-7747-4c99-b94d-d62fec384bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:53.650636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9c79-7747-4c99-b94d-d62fec384bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:53.661316 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b9c79-7747-4c99-b94d-d62fec384bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:35:53.662757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b9c79-7747-4c99-b94d-d62fec384bb8 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:35:53.673843 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1464/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:35:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:03.602467 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=41 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:03.669385 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=24 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:09.685507 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a7a2-0c65-4275-9fe5-767ce79796d7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:09.686248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a7a2-0c65-4275-9fe5-767ce79796d7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:09.686248 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a7a2-0c65-4275-9fe5-767ce79796d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:09.755142 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-35d2a7a2-0c65-4275-9fe5-767ce79796d7 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:09.757112 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-35d2a7a2-0c65-4275-9fe5-767ce79796d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:09.833376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1468/2932] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:09.841232 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5fba1-0962-46fb-9ebf-dd9248255507 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:09.843088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5fba1-0962-46fb-9ebf-dd9248255507 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:09.843521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5fba1-0962-46fb-9ebf-dd9248255507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:09.872377 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-dbe5fba1-0962-46fb-9ebf-dd9248255507 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:09.875767 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dbe5fba1-0962-46fb-9ebf-dd9248255507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:09.886618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1465/2933] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:09.889481 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5856-5804-4ccc-adc5-c47ae2deb993 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:09.889759 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5856-5804-4ccc-adc5-c47ae2deb993 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:09.890219 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5856-5804-4ccc-adc5-c47ae2deb993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:09.903220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5fba1-0962-46fb-9ebf-dd9248255507 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:09.915913 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5fba1-0962-46fb-9ebf-dd9248255507 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:09.921470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:09.922131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:09.922402 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:09.922677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:09.935454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:09.937236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:09.949880 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1466/2934] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:09.952338 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a1eb5856-5804-4ccc-adc5-c47ae2deb993 None None] MFA Rules not processed for user `861b64b65d2642afbacfa20851257333`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:09.953602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a1eb5856-5804-4ccc-adc5-c47ae2deb993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:10.034036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1469/2935] 10.222.0.20 () {58 vars in 1040 bytes} [Fri Sep 30 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:10.040533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:10.052684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c4bc9-b239-4395-9fb5-598163708f2c service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:10.058038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:10.058642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:10.058918 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:10.059183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:10.067670 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:10.069349 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:10.077583 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1467/2936] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:36:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:36:20.031032 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=88 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:20.074255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=15 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:22.938503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0894d-6d8b-4fca-9067-706a6dfe9638 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:22.939068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0894d-6d8b-4fca-9067-706a6dfe9638 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:22.939068 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0894d-6d8b-4fca-9067-706a6dfe9638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:22.978945 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d9a0894d-6d8b-4fca-9067-706a6dfe9638 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:22.980202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d9a0894d-6d8b-4fca-9067-706a6dfe9638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:22.987379 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1470/2937] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:36:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:22.999167 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:23.009246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03e22-0c35-4369-afca-a4f75a9c10b3 service swift] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:23.013286 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4f8e2-f439-4da9-b4ee-6d8447be6a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:23.013912 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4f8e2-f439-4da9-b4ee-6d8447be6a31 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:23.014183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4f8e2-f439-4da9-b4ee-6d8447be6a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:23.014431 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4f8e2-f439-4da9-b4ee-6d8447be6a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:23.022042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4f8e2-f439-4da9-b4ee-6d8447be6a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:23.023477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4f8e2-f439-4da9-b4ee-6d8447be6a31 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:23.032170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1468/2938] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:24.176949 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7271-85e4-4bfe-be46-3c098e403900 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:24.177482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7271-85e4-4bfe-be46-3c098e403900 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:24.177482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7271-85e4-4bfe-be46-3c098e403900 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:24.179412 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1471/2939] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 30 10:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:36:24.184761 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe301f-c828-4d7c-b7fb-945191a0c60f None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:24.185226 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe301f-c828-4d7c-b7fb-945191a0c60f None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:24.185447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe301f-c828-4d7c-b7fb-945191a0c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:24.206344 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-afbe301f-c828-4d7c-b7fb-945191a0c60f None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:24.207636 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-afbe301f-c828-4d7c-b7fb-945191a0c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:24.218409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1469/2940] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:36:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:24.231108 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7271-85e4-4bfe-be46-3c098e403900 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:24.242422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7271-85e4-4bfe-be46-3c098e403900 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:24.246721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77625f61bca4548af4cd5702d2b807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:24.246893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:24.247166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:24.247431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:24.258075 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:24.259551 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:24.270734 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1472/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:24.346873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe301f-c828-4d7c-b7fb-945191a0c60f None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:24.356513 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe301f-c828-4d7c-b7fb-945191a0c60f None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:24.360108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a05817-537f-4464-8b8c-78f5a4f47090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:24.360702 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05817-537f-4464-8b8c-78f5a4f47090 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:24.360969 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05817-537f-4464-8b8c-78f5a4f47090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:24.361236 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05817-537f-4464-8b8c-78f5a4f47090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:24.362974 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-35a05817-537f-4464-8b8c-78f5a4f47090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:24.372379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a05817-537f-4464-8b8c-78f5a4f47090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:24.373810 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a05817-537f-4464-8b8c-78f5a4f47090 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:24.381458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1470/2942] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:24.460482 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:24.470252 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76436a58-4a01-46bd-bb17-c06636e28812 service glance] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:24.474231 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:24.474815 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:24.475083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:24.475349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:24.477244 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:24.490723 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:24.492145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:24.503071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1473/2943] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:24.568879 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c8457-7f52-489a-8e3e-be6e1b2e65c8 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:24.569204 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c8457-7f52-489a-8e3e-be6e1b2e65c8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:24.569472 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c8457-7f52-489a-8e3e-be6e1b2e65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:24.603863 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-627c8457-7f52-489a-8e3e-be6e1b2e65c8 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:24.605186 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-627c8457-7f52-489a-8e3e-be6e1b2e65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:24.687594 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1471/2944] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 10:36:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:24.696363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:24.708085 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333d33a-c176-4197-9e31-2792b64e509f service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:24.714453 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:24.715050 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:24.715318 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:24.715575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:24.717607 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:24.730232 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:24.731839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:24.741908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1474/2945] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:26.511542 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f5c2-74a4-4a0a-852d-2c3ed6e3f623 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:26.512039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f5c2-74a4-4a0a-852d-2c3ed6e3f623 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:26.512039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f5c2-74a4-4a0a-852d-2c3ed6e3f623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:26.533380 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-e019f5c2-74a4-4a0a-852d-2c3ed6e3f623 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:26.534661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-e019f5c2-74a4-4a0a-852d-2c3ed6e3f623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:26.543498 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1472/2946] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:36:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:26.555832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:26.567792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ccaf4-db23-402d-850e-2be155b092f0 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:26.573441 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249cbb6-cbb6-4e2a-a8b1-e75966986940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:26.574078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249cbb6-cbb6-4e2a-a8b1-e75966986940 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:26.574342 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249cbb6-cbb6-4e2a-a8b1-e75966986940 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:26.574602 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249cbb6-cbb6-4e2a-a8b1-e75966986940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:26.583769 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249cbb6-cbb6-4e2a-a8b1-e75966986940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:26.585376 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249cbb6-cbb6-4e2a-a8b1-e75966986940 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:26.594057 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1475/2947] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:36:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:36:36.527748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=56 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:36.590874 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=33 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:45.418656 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f5c2-74a4-4a0a-852d-2c3ed6e3f623 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:45.432028 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f5c2-74a4-4a0a-852d-2c3ed6e3f623 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:45.437466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9639-105a-4508-a704-a34335e33792 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:45.438337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9639-105a-4508-a704-a34335e33792 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:45.438609 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9639-105a-4508-a704-a34335e33792 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:45.438873 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9639-105a-4508-a704-a34335e33792 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:45.440833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-394b9639-105a-4508-a704-a34335e33792 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:45.453043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b9639-105a-4508-a704-a34335e33792 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:45.454732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b9639-105a-4508-a704-a34335e33792 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:45.464817 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1473/2948] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:46.068345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb9e8-56fd-493c-b4b9-5db9b896b86e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:46.068836 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb9e8-56fd-493c-b4b9-5db9b896b86e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:46.068951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb9e8-56fd-493c-b4b9-5db9b896b86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:46.089324 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-178fb9e8-56fd-493c-b4b9-5db9b896b86e None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:46.090579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-178fb9e8-56fd-493c-b4b9-5db9b896b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:46.099080 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1476/2949] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 30 10:36:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:46.112303 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9639-105a-4508-a704-a34335e33792 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:46.124175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9639-105a-4508-a704-a34335e33792 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:46.130145 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad90e46-000b-480e-8bb4-2dbbb4ded662 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:46.130839 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad90e46-000b-480e-8bb4-2dbbb4ded662 service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:46.131115 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad90e46-000b-480e-8bb4-2dbbb4ded662 service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:46.131379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad90e46-000b-480e-8bb4-2dbbb4ded662 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:46.139518 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad90e46-000b-480e-8bb4-2dbbb4ded662 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:46.141217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad90e46-000b-480e-8bb4-2dbbb4ded662 service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:46.149453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1474/2950] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:36:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:36:56.083947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:56.146177 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:22.748436 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb9e8-56fd-493c-b4b9-5db9b896b86e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:22.789432 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb9e8-56fd-493c-b4b9-5db9b896b86e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:22.794036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:22.794633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:22.794908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:22.795170 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:22.803832 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:22.805349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:22.815031 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1477/2951] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:23.691665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43e82-9fcb-44d5-913d-5243abafcee8 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:23.692223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43e82-9fcb-44d5-913d-5243abafcee8 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:23.692223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43e82-9fcb-44d5-913d-5243abafcee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:23.725252 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-dca43e82-9fcb-44d5-913d-5243abafcee8 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:23.726679 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-dca43e82-9fcb-44d5-913d-5243abafcee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:23.737833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1475/2952] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:23.756835 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:23.774241 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31fcfd-f2f6-4bfb-b8ef-58b687d48bf1 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:23.782399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:23.783018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:23.783296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:23.783563 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:23.793988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:23.795444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:23.807841 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1478/2953] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:25.922606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555e8ac-fc0e-411c-9528-3d8f8752a3c5 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:25.923126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555e8ac-fc0e-411c-9528-3d8f8752a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:25.923126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555e8ac-fc0e-411c-9528-3d8f8752a3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:25.944300 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-5555e8ac-fc0e-411c-9528-3d8f8752a3c5 None None] MFA Rules not processed for user `e45d799ba78f4adc82f3ffdc9293ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:25.945921 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-5555e8ac-fc0e-411c-9528-3d8f8752a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:25.956928 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1476/2954] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:25.969784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:25.981784 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad941d2-9b62-4899-b974-c2cc9755341c service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:25.987801 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389c257-043b-4f20-bba2-ddc452929db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:25.988399 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389c257-043b-4f20-bba2-ddc452929db7 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:25.988668 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389c257-043b-4f20-bba2-ddc452929db7 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:25.988934 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389c257-043b-4f20-bba2-ddc452929db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:25.998530 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389c257-043b-4f20-bba2-ddc452929db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:26.000137 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389c257-043b-4f20-bba2-ddc452929db7 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:26.010948 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1479/2955] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:28.589819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedb95-1965-4cf2-b2bf-ea47703e4c88 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:28.590326 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedb95-1965-4cf2-b2bf-ea47703e4c88 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:28.590432 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedb95-1965-4cf2-b2bf-ea47703e4c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:28.610401 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-7ddedb95-1965-4cf2-b2bf-ea47703e4c88 None None] MFA Rules not processed for user `56ec8e1b39f34df7a5ec433682772c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:28.611619 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7ddedb95-1965-4cf2-b2bf-ea47703e4c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:28.622831 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1477/2956] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:38:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:36.006473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=28 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:38.620914 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=15 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:45.337098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f1c6-9d65-4914-91e7-dbd5722f2e52 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:45.337663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f1c6-9d65-4914-91e7-dbd5722f2e52 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:45.337663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f1c6-9d65-4914-91e7-dbd5722f2e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:45.361266 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cfb4f1c6-9d65-4914-91e7-dbd5722f2e52 None None] MFA Rules not processed for user `c89d986ea1b3488a8873b2e0e87b1ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:45.362501 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cfb4f1c6-9d65-4914-91e7-dbd5722f2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:45.369896 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1480/2957] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:38:45.381747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedb95-1965-4cf2-b2bf-ea47703e4c88 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:45.392284 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedb95-1965-4cf2-b2bf-ea47703e4c88 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:45.397047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:45.397642 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:45.397964 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:45.398225 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:45.405823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:45.407260 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:45.415411 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1478/2958] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:46.922143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fd732-e218-4e7f-a27b-8f1b495fa6c1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:46.922575 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fd732-e218-4e7f-a27b-8f1b495fa6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:46.922674 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fd732-e218-4e7f-a27b-8f1b495fa6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:46.962498 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a26fd732-e218-4e7f-a27b-8f1b495fa6c1 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:46.963699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a26fd732-e218-4e7f-a27b-8f1b495fa6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:46.973320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1481/2959] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 30 10:38:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:46.979466 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:46.993108 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74acfd2-c0a5-4015-86ee-d8dc7d60a533 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:46.998940 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:46.999569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:46.999845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:47.000122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:47.001902 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:47.014309 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:47.015892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:47.026135 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1479/2960] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:56.960169 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=12 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:57.022181 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:39:09.881310 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fd732-e218-4e7f-a27b-8f1b495fa6c1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:39:09.890726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fd732-e218-4e7f-a27b-8f1b495fa6c1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:39:09.894197 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:39:09.894789 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:39:09.895058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:39:09.895320 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:39:09.904651 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:39:09.906159 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:39:09.917105 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1482/2961] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:39:19.912104 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:39:43.654246 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:39:43.663972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051130e-e7de-41a8-bcb2-ea4e20b300bd service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:39:43.668361 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:39:43.668954 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:39:43.669224 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:39:43.669485 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:39:43.676829 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:39:43.678291 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:39:43.686414 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1480/2962] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:39:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:39:53.683114 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:09.274307 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:09.287145 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9dba1-15c2-49bf-8812-9957ae37092e service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:09.291510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:09.292103 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:09.292372 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:09.292637 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:09.309505 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:09.310996 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:09.332148 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1483/2963] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:10.542796 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:10.552287 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff8af-3ddd-48a0-a1a4-c991a81c92e6 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:10.556201 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:10.556800 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:10.557074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:10.557337 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:10.567153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:10.568566 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:10.579933 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1481/2964] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:19.329262 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=13 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:20.575083 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:24.069623 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:24.079056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc913cb6-7428-49c0-91be-a3a67fc85376 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:24.083122 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:24.083728 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:24.084003 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:24.084273 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:24.092132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:24.093583 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:24.101907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1484/2965] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:24.143543 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:24.152757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691566-6d1f-467b-be87-27e9276d982b service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:24.157403 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:24.158050 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:24.158327 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:24.158595 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:24.169713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:24.171198 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:24.185983 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1482/2966] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:24.247881 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:24.262714 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2529b-b60e-48fc-83ba-a0db9750c694 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:24.268849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:24.269444 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:24.269721 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:24.270028 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:24.279597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:24.281184 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:24.290802 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1485/2967] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:25.125819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:25.138671 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af952fec-14c7-408b-bef1-31658a09561c service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:25.145899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:25.147150 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:25.147598 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:25.148120 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:25.159131 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:25.160727 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:25.173289 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1483/2968] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:34.287000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=12 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:35.167724 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=12 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:49.923468 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:49.935274 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cc0ef-fbe0-49b1-ab27-fe168ce0cd86 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:49.941779 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3315-2fda-4708-a2f9-4e498dfe956f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:49.942404 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3315-2fda-4708-a2f9-4e498dfe956f service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:49.942794 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3315-2fda-4708-a2f9-4e498dfe956f service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:49.943083 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3315-2fda-4708-a2f9-4e498dfe956f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:49.952128 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3315-2fda-4708-a2f9-4e498dfe956f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:49.953767 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3315-2fda-4708-a2f9-4e498dfe956f service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:49.963910 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1486/2969] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:59.959792 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:09.431016 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:09.432804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:09.462731 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9dc9b-2258-4233-a65f-21da59a0752a service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:09.466553 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:09.467290 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:09.467660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:09.468024 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:09.470200 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:09.564770 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:09.566565 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:09.586677 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1484/2970] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:12.890621 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:12.891187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:12.891456 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:12.922871 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:12.925719 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:12.934656 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1487/2971] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:12.946452 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:12.963942 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3311-7f03-4bbb-b534-93d29c1fe764 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:12.969061 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:12.969771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:12.970152 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:12.970482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:12.981099 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:12.982755 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:12.993082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1485/2972] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:16.288000 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:16.289658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:16.304224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c7b1-7fa7-4bb8-8789-e2fae606050b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:16.309675 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:16.310333 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:16.310606 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:16.310873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] PATH_INFO: `/v3/users/56ec8e1b39f34df7a5ec433682772c5c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:16.325682 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ec8e1b39f34df7a5ec433682772c5c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:16.327724 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:16.377543 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ec8e1b39f34df7a5ec433682772c5c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.391294 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ec8e1b39f34df7a5ec433682772c5c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.392071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ec8e1b39f34df7a5ec433682772c5c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.392765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ec8e1b39f34df7a5ec433682772c5c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.406578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ec8e1b39f34df7a5ec433682772c5c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.422188 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1488/2973] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:43:16 2022] DELETE /identity/v3/users/56ec8e1b39f34df7a5ec433682772c5c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:43:16.604447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:16.622310 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507d85-35e2-4776-adf9-d0a36067e185 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:16.682808 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:16.683355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:16.683600 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:16.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] PATH_INFO: `/v3/projects/ec599e66d93148cf8017b758fe4d314f` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:16.694509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec599e66d93148cf8017b758fe4d314f)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:16.696409 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:16.734342 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:16.744993 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec599e66d93148cf8017b758fe4d314f', 'request_id': 'req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.751112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec599e66d93148cf8017b758fe4d314f', 'request_id': 'req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.760255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec599e66d93148cf8017b758fe4d314f', 'request_id': 'req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.774030 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] The token cache is being invalidate because project ec599e66d93148cf8017b758fe4d314f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:43:16.774312 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.775067 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.776692 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1486/2974] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:43:16 2022] DELETE /identity/v3/projects/ec599e66d93148cf8017b758fe4d314f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:43:16.782921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:16.786243 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:16.808899 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb5195-c578-458e-84e6-b61cf39d5c47 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:16.868458 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:16.869084 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:16.869361 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:16.869633 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] PATH_INFO: `/v3/users/e8d6d5dbbd2244059b160ffebc3bc51a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:16.883287 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d6d5dbbd2244059b160ffebc3bc51a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:16.885245 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:16.934663 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:16.945187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d6d5dbbd2244059b160ffebc3bc51a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.952078 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d6d5dbbd2244059b160ffebc3bc51a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.952726 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d6d5dbbd2244059b160ffebc3bc51a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.953319 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d6d5dbbd2244059b160ffebc3bc51a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.965349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9db6f65e-aae7-4993-9d78-e4cd2320d02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d6d5dbbd2244059b160ffebc3bc51a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:16.981680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1489/2975] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:43:16 2022] DELETE /identity/v3/users/e8d6d5dbbd2244059b160ffebc3bc51a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:43:17.151363 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.153302 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:17.171729 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13ecf4-73d6-4ccc-a2d6-a77f1716eb37 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.229906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.230552 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.230821 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.231211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] PATH_INFO: `/v3/projects/fe8a620a8c3b4f9a96e1dbfc5cc09b96` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.243719 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8a620a8c3b4f9a96e1dbfc5cc09b96)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.245738 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.295163 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8a620a8c3b4f9a96e1dbfc5cc09b96', 'request_id': 'req-25cec37c-9a63-4940-af78-0b9b8d87b4e2'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:17.301021 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8a620a8c3b4f9a96e1dbfc5cc09b96', 'request_id': 'req-25cec37c-9a63-4940-af78-0b9b8d87b4e2'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:17.308826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8a620a8c3b4f9a96e1dbfc5cc09b96', 'request_id': 'req-25cec37c-9a63-4940-af78-0b9b8d87b4e2'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:17.321827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] The token cache is being invalidate because project fe8a620a8c3b4f9a96e1dbfc5cc09b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81731) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:43:17.321827 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:17.322567 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-25cec37c-9a63-4940-af78-0b9b8d87b4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:17.328249 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1487/2976] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:43:17 2022] DELETE /identity/v3/projects/fe8a620a8c3b4f9a96e1dbfc5cc09b96 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:43:17.329423 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbe58-5a41-4dc9-aae1-d28cfd7a50b7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.329884 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbe58-5a41-4dc9-aae1-d28cfd7a50b7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.330026 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbe58-5a41-4dc9-aae1-d28cfd7a50b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.377643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-aecfbe58-5a41-4dc9-aae1-d28cfd7a50b7 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:17.378909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-aecfbe58-5a41-4dc9-aae1-d28cfd7a50b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:17.440147 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1490/2977] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:43:17.449165 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c567577-bf9e-47df-bfc1-fcb8b8aeea85 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.449444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c567577-bf9e-47df-bfc1-fcb8b8aeea85 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.449714 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c567577-bf9e-47df-bfc1-fcb8b8aeea85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.470214 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-1c567577-bf9e-47df-bfc1-fcb8b8aeea85 None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:17.471461 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-1c567577-bf9e-47df-bfc1-fcb8b8aeea85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:17.479872 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1488/2978] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:17.484141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfbe58-5a41-4dc9-aae1-d28cfd7a50b7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.499438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfbe58-5a41-4dc9-aae1-d28cfd7a50b7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.507893 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.508670 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.508942 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.509205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.509880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:43:17.510187 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.511811 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.524658 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1491/2979] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 30 10:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:43:17.530350 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c567577-bf9e-47df-bfc1-fcb8b8aeea85 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.544558 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c567577-bf9e-47df-bfc1-fcb8b8aeea85 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.552654 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.553254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.553522 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.553778 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.554419 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.556329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.602780 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1489/2980] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:43:17 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:43:17.609048 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.620875 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412d104-df66-4ca7-af78-c723860d8552 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.678873 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.679478 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.679748 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.680009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.680624 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.682582 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.707531 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1492/2981] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:43:17 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:43:17.713318 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.724158 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace944e0-175e-4831-afff-c732de9d18f8 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.729171 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.729777 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.730139 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.730355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.731077 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.732686 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.733965 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:17.747892 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1490/2982] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:43:17.749260 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.759570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139e65-0ab2-4f55-8a5a-1d50c73036ad admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.764251 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39d208-74be-4d00-ac29-0d931bed09ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.764909 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39d208-74be-4d00-ac29-0d931bed09ee admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.765157 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39d208-74be-4d00-ac29-0d931bed09ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.765422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39d208-74be-4d00-ac29-0d931bed09ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.766205 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39d208-74be-4d00-ac29-0d931bed09ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.767867 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39d208-74be-4d00-ac29-0d931bed09ee admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.770346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:17.779741 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1493/2983] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:43:17.784113 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.794375 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67802fe5-f620-4d8c-9965-3babfcf79157 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.799437 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.800078 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.800353 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.800618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] PATH_INFO: `/v3/projects/de7948fb58dd4ac6a7f25f174896c37e/users/3051fcf3dc974d0f85fa33da0fbbd0a6/roles/782248b1f9c44339b15e3eb0eabcd15a` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.815521 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7948fb58dd4ac6a7f25f174896c37e, user_id=3051fcf3dc974d0f85fa33da0fbbd0a6, role_id=782248b1f9c44339b15e3eb0eabcd15a)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.818407 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.837623 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1491/2984] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:43:17 2022] PUT /identity/v3/projects/de7948fb58dd4ac6a7f25f174896c37e/users/3051fcf3dc974d0f85fa33da0fbbd0a6/roles/782248b1f9c44339b15e3eb0eabcd15a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:43:17.845418 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24916e2-06f0-43f8-a851-ee73d50616ae None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.845857 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24916e2-06f0-43f8-a851-ee73d50616ae None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.846196 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24916e2-06f0-43f8-a851-ee73d50616ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.866538 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b24916e2-06f0-43f8-a851-ee73d50616ae None None] MFA Rules not processed for user `ea3875a2ed124d19b88d1590553ab6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:17.867771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b24916e2-06f0-43f8-a851-ee73d50616ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:17.927472 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1494/2985] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:17.937628 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.939533 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:18.000520 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829d1a-42df-4539-92c4-164df56fe351 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:18.004788 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:18.005743 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:18.006043 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:18.006314 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:18.016005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:18.017453 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:18.027732 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1492/2986] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:21.799421 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98fe22-4d51-49d2-baa9-56b7e335f0d3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.799980 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98fe22-4d51-49d2-baa9-56b7e335f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.800254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98fe22-4d51-49d2-baa9-56b7e335f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.832554 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2a98fe22-4d51-49d2-baa9-56b7e335f0d3 None None] MFA Rules not processed for user `3051fcf3dc974d0f85fa33da0fbbd0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:21.834119 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2a98fe22-4d51-49d2-baa9-56b7e335f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:21.903173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1495/2987] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:21.907789 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.918122 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a560b5-a89a-484e-9987-1a5d72b88c42 service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.922728 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.923493 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.923771 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.924046 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.924720 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.926747 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.956748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1493/2988] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:43:21.960771 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98fe22-4d51-49d2-baa9-56b7e335f0d3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.972027 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98fe22-4d51-49d2-baa9-56b7e335f0d3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:22.047620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:22.047941 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:22.048283 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:22.048553 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:22.049308 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:22.051641 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:22.077289 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1496/2989] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:43:22.081378 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:22.093123 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76c8ff-9848-4567-b3dc-3a5f890c0f6e admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:22.098458 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:22.099053 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:22.099331 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:22.099601 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:22.100239 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:22.101852 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:22.112593 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1494/2990] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:43:22.116927 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:22.127093 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f9dfc-9807-4547-a8fc-217dd1bb8bb7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:22.132261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:22.132914 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:22.133189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:22.133486 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] PATH_INFO: `/v3/projects/17f946567d1345d5acd90df5fe835275/users/29394cd123de4abb9e3e0b5cbf555510/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:22.148830 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f946567d1345d5acd90df5fe835275, user_id=29394cd123de4abb9e3e0b5cbf555510, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:22.151631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:22.154431 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:22.168225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1497/2991] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:43:22 2022] PUT /identity/v3/projects/17f946567d1345d5acd90df5fe835275/users/29394cd123de4abb9e3e0b5cbf555510/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:43:22.172371 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:22.182885 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89b5b-c0d5-46cd-9419-c9d6d4b21427 admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:22.238972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2276b-00c9-4a16-8010-54fb7985bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:22.239706 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2276b-00c9-4a16-8010-54fb7985bfcb admin admin] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:22.239984 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2276b-00c9-4a16-8010-54fb7985bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:22.240255 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2276b-00c9-4a16-8010-54fb7985bfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:22.240887 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2276b-00c9-4a16-8010-54fb7985bfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:22.242557 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2276b-00c9-4a16-8010-54fb7985bfcb admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:22.252511 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1495/2992] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 30 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:43:22.257036 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:22.267631 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fab5-6e61-4b47-a586-138368750934 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:22.272825 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:22.273503 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:22.273897 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:22.274301 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] PATH_INFO: `/v3/projects/17f946567d1345d5acd90df5fe835275/users/29394cd123de4abb9e3e0b5cbf555510/roles/1348b8ebea08426882910c6e9c3b6e78` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:22.276250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f946567d1345d5acd90df5fe835275, user_id=29394cd123de4abb9e3e0b5cbf555510, role_id=1348b8ebea08426882910c6e9c3b6e78)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:22.279346 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:22.290070 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1498/2993] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 30 10:43:22 2022] PUT /identity/v3/projects/17f946567d1345d5acd90df5fe835275/users/29394cd123de4abb9e3e0b5cbf555510/roles/1348b8ebea08426882910c6e9c3b6e78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:43:26.965011 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52433a51-ee20-437a-aec7-bc22dffc1d55 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:26.965569 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52433a51-ee20-437a-aec7-bc22dffc1d55 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:26.965946 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52433a51-ee20-437a-aec7-bc22dffc1d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:27.010265 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-52433a51-ee20-437a-aec7-bc22dffc1d55 None None] MFA Rules not processed for user `29394cd123de4abb9e3e0b5cbf555510`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:27.011662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-52433a51-ee20-437a-aec7-bc22dffc1d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:27.047660 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:27.103877 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1496/2994] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:43:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:27.121683 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:27.123960 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:27.226568 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af76ce-c309-4516-b5d0-786074b3a1f5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:27.233224 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:27.234056 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:27.234428 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:27.234785 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:27.315755 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:27.317526 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:27.330422 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1499/2995] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:28.341527 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:28.342180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:28.342180 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:28.363047 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] MFA Rules not processed for user `3051fcf3dc974d0f85fa33da0fbbd0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:28.364262 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:28.371479 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1497/2996] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:43:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:28.704780 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:28.706560 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:28.768746 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4102a7-d187-4eef-b798-303940b962aa service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:28.773158 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:28.773768 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:28.774089 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:28.774359 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:28.776163 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:28.786992 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:28.788435 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:28.797408 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1500/2997] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:36.231160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:36.232633 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:36.257975 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e41a-f7b0-4700-be61-381929a57360 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:36.266494 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:36.267365 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:36.267644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:36.267906 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:36.270153 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:36.286298 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:36.288020 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:36.299347 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1498/2998] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:38.793657 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=2,keystone:SELECT=94 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:44.797330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:44.809363 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e011e-97cb-4b43-b2a4-54332ed2b3d4 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:44.816071 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:44.816799 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:44.817113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:44.817349 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:44.827517 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:44.828955 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:44.839061 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1501/2999] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:46.294899 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=26 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:46.783673 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:46.795235 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae92a2-e376-4f84-859d-7de7132722c9 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:46.801397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d2c83-026e-4ffa-a019-327d3bd56335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:46.802082 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d2c83-026e-4ffa-a019-327d3bd56335 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:46.802444 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d2c83-026e-4ffa-a019-327d3bd56335 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:46.802765 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d2c83-026e-4ffa-a019-327d3bd56335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:46.804563 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-be1d2c83-026e-4ffa-a019-327d3bd56335 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:46.816707 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d2c83-026e-4ffa-a019-327d3bd56335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:46.818397 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d2c83-026e-4ffa-a019-327d3bd56335 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:46.828745 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1499/3000] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:54.834597 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:56.824782 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:51.642330 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:51.652427 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349345b7-911d-4737-bdac-e64dad906227 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:51.657250 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:51.657831 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:51.658132 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:51.658400 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:51.660614 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:51.670999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:51.672455 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:51.680620 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1502/3001] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:45:01.677194 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:13.638939 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5981e81-ee17-4843-8cf4-ca3c7e4c79e5 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:13.639455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5981e81-ee17-4843-8cf4-ca3c7e4c79e5 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:13.639455 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5981e81-ee17-4843-8cf4-ca3c7e4c79e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:13.706039 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-f5981e81-ee17-4843-8cf4-ca3c7e4c79e5 None None] MFA Rules not processed for user `b77625f61bca4548af4cd5702d2b807a`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:13.707251 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-f5981e81-ee17-4843-8cf4-ca3c7e4c79e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:13.772978 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1500/3002] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 30 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:13.779999 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:13.789450 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a43f7-e657-40ed-937e-e17dacdae2de service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:13.793561 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77625f61bca4548af4cd5702d2b807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:13.794190 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:13.794462 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:13.794738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:13.796643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:13.832971 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:13.834451 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:13.845645 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1503/3003] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:23.430068 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ce6c0-cd1a-411f-93bf-ebefb65d7f9e None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:23.430603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ce6c0-cd1a-411f-93bf-ebefb65d7f9e None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:23.430603 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ce6c0-cd1a-411f-93bf-ebefb65d7f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:23.481474 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-d63ce6c0-cd1a-411f-93bf-ebefb65d7f9e None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:23.482713 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-d63ce6c0-cd1a-411f-93bf-ebefb65d7f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:23.548523 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1501/3004] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:23.598851 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:23.600813 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:23.698921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3e1cf-2ec0-4d5c-8466-5cec31ed73d1 service glance] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:23.707321 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:23.708117 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:23.708396 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:23.708630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:23.719297 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:23.720894 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:23.728953 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1504/3005] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:46:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:46:32.713833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:32.714394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:32.714394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:32.734644 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] MFA Rules not processed for user `3051fcf3dc974d0f85fa33da0fbbd0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:32.735781 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:32.743757 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1502/3006] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 30 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:33.077858 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:33.092225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a836ae-14a8-42e7-8283-40d334071378 service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:33.099235 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:33.100041 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:33.100369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:33.100680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:33.103890 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:33.117296 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:33.118880 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:33.127238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1505/3007] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:33.452871 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:33.454766 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:33.463957 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:33.474021 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127272-6182-4202-adfe-38f72fe10a8f service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:33.478495 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c98bd-68f4-4584-99cc-cc53f5aa3d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:33.479098 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c98bd-68f4-4584-99cc-cc53f5aa3d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:33.479473 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c98bd-68f4-4584-99cc-cc53f5aa3d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:33.479735 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c98bd-68f4-4584-99cc-cc53f5aa3d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:33.481729 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3a4c98bd-68f4-4584-99cc-cc53f5aa3d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:33.495409 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c98bd-68f4-4584-99cc-cc53f5aa3d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:33.495648 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=100 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:33.496943 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c98bd-68f4-4584-99cc-cc53f5aa3d0c service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:33.508082 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1506/3008] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:33.551323 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b9467-6070-411e-b177-0d12f56c6bf9 None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:33.556823 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:33.557433 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:33.557705 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:33.558005 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:33.559966 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:33.571491 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:33.572997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:33.582447 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1503/3009] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:35.024951 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e4ae-0a0f-434f-9441-403a8f7ec9d6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:35.025461 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e4ae-0a0f-434f-9441-403a8f7ec9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:35.025565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e4ae-0a0f-434f-9441-403a8f7ec9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:35.048649 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-db41e4ae-0a0f-434f-9441-403a8f7ec9d6 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:35.049986 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-db41e4ae-0a0f-434f-9441-403a8f7ec9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:35.058470 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1507/3010] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:35.072045 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:35.083925 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4c55-9367-4179-89ce-acad5d64c0e9 service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:35.095662 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:35.096398 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:35.096915 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:35.097174 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:35.106382 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:35.108148 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:35.117254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1504/3011] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:46:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:46:36.718717 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41e4ae-0a0f-434f-9441-403a8f7ec9d6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:36.740225 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41e4ae-0a0f-434f-9441-403a8f7ec9d6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:36.755369 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:36.755988 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:36.756261 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:36.757096 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:36.759183 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:36.772029 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:36.773833 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:36.784695 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1508/3012] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:45.113758 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=32 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:46.780677 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=77 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:55.515703 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:55.517374 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:55.533960 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83823fa-11a2-48b3-8ba0-907b74c6b35c service swift] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:55.539509 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda90b6c-d027-4bbd-bee5-01ec6af279eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:55.540126 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90b6c-d027-4bbd-bee5-01ec6af279eb service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:55.540399 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90b6c-d027-4bbd-bee5-01ec6af279eb service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:55.540659 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90b6c-d027-4bbd-bee5-01ec6af279eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:55.542861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-cda90b6c-d027-4bbd-bee5-01ec6af279eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:55.555211 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda90b6c-d027-4bbd-bee5-01ec6af279eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:55.556822 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda90b6c-d027-4bbd-bee5-01ec6af279eb service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:55.567588 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1505/3013] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:47:05.563460 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=6 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:48:55.631979 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:48:55.653843 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817c58-4ad6-45df-a04d-88ad77be6d5d service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:48:55.659635 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:48:55.660238 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:48:55.660510 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:48:55.660765 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:48:55.669226 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:48:55.670826 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:48:55.679853 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1509/3014] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:48:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:49:03.951833 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79169695-9410-4bea-830c-afa03cc9d9a2 None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:03.952368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79169695-9410-4bea-830c-afa03cc9d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:03.952368 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79169695-9410-4bea-830c-afa03cc9d9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:03.988088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-79169695-9410-4bea-830c-afa03cc9d9a2 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:49:03.989294 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-79169695-9410-4bea-830c-afa03cc9d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:04.006972 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1506/3015] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 30 10:49:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:49:04.047627 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:04.059254 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c446101-0173-41ea-b029-ad0234509576 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:04.064703 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:04.065299 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:04.065565 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:04.065839 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:04.073907 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:04.075499 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:04.083630 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1510/3016] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:49:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:49:13.535325 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c5a6a-5efd-4d79-867c-ef7851f27c3b None None] REQUEST_METHOD: `POST` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:13.535876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c5a6a-5efd-4d79-867c-ef7851f27c3b None None] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:13.535876 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c5a6a-5efd-4d79-867c-ef7851f27c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:13.556682 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.auth.core [None req-fd3c5a6a-5efd-4d79-867c-ef7851f27c3b None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81731) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:49:13.557997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-fd3c5a6a-5efd-4d79-867c-ef7851f27c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:13.566215 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1507/3017] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 30 10:49:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:49:13.578796 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:13.589787 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb37da-43ee-4412-ae0a-f9c678d45b8d service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:13.597153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad2f8-cc9a-4c0f-a035-a3ca8bfa0fe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:13.597756 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad2f8-cc9a-4c0f-a035-a3ca8bfa0fe9 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:13.598058 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad2f8-cc9a-4c0f-a035-a3ca8bfa0fe9 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:13.598322 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad2f8-cc9a-4c0f-a035-a3ca8bfa0fe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:13.606738 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ad2f8-cc9a-4c0f-a035-a3ca8bfa0fe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:13.608403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ad2f8-cc9a-4c0f-a035-a3ca8bfa0fe9 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:13.616760 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1511/3018] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:49:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:49:14.820661 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c5a6a-5efd-4d79-867c-ef7851f27c3b None None] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:14.836577 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c5a6a-5efd-4d79-867c-ef7851f27c3b None None] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:14.844160 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:14.844997 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:14.845355 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:14.845684 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:14.855418 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:14.857117 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:14.869121 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1508/3019] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:49:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:49:18.508316 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1d4a-ef9a-43a3-b4ff-62942ee98310 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:18.508820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1d4a-ef9a-43a3-b4ff-62942ee98310 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:18.508820 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1d4a-ef9a-43a3-b4ff-62942ee98310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:18.516838 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=24 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:49:18.531437 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dead1d4a-ef9a-43a3-b4ff-62942ee98310 None None] MFA Rules not processed for user `20cb8cab884f4c1ab8a365b944df70e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:49:18.532653 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dead1d4a-ef9a-43a3-b4ff-62942ee98310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:18.542916 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1512/3020] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 30 10:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:49:18.558003 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:18.570034 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8623cd-b75e-4de0-a758-5ade8505c637 service nova] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:18.576379 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861b64b65d2642afbacfa20851257333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:18.576971 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:18.577222 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:18.577482 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:18.586819 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:18.588423 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:18.597088 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1509/3021] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 30 10:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:49:19.946803 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead1d4a-ef9a-43a3-b4ff-62942ee98310 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:19.960345 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead1d4a-ef9a-43a3-b4ff-62942ee98310 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:19.968940 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada85d1f-eeb7-412e-8341-e17aa98dbdcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45d799ba78f4adc82f3ffdc9293ff20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:19.969840 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85d1f-eeb7-412e-8341-e17aa98dbdcb service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:19.970009 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85d1f-eeb7-412e-8341-e17aa98dbdcb service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:19.970365 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85d1f-eeb7-412e-8341-e17aa98dbdcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:19.979905 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada85d1f-eeb7-412e-8341-e17aa98dbdcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:19.981850 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada85d1f-eeb7-412e-8341-e17aa98dbdcb service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:19.993206 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1513/3022] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:49:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:49:23.713606 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:23.734322 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c04bd0-ba05-403e-9356-ea333efee3fd service swift] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:23.738280 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89d986ea1b3488a8873b2e0e87b1ce5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:23.738927 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:23.739217 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:23.739470 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:23.806748 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:23.808170 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:23.820038 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1510/3023] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:49:27.018958 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987a79-61ac-4d9d-87e7-09a722048077 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:27.019519 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987a79-61ac-4d9d-87e7-09a722048077 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:27.019643 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987a79-61ac-4d9d-87e7-09a722048077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:27.065153 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f3987a79-61ac-4d9d-87e7-09a722048077 None None] MFA Rules not processed for user `d7777f87a39a47999af1bfda0b3883d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:49:27.066425 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f3987a79-61ac-4d9d-87e7-09a722048077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:27.076279 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1514/3024] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 30 10:49:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:49:27.092063 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:27.099469 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=61 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:49:27.109175 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15446f1d-4e01-4d33-ac1c-70582062917f service neutron] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:27.115804 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:27.116500 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:27.116986 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:27.117254 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:27.126951 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:27.128792 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:27.139106 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1511/3025] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:49:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:49:30.348648 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987a79-61ac-4d9d-87e7-09a722048077 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:30.359642 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987a79-61ac-4d9d-87e7-09a722048077 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:30.365413 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:30.366165 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:30.366438 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:30.366699 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:30.368578 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:30.381007 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:30.382892 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:30.393487 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1515/3026] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:49:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:49:30.404248 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:30.415741 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1172-fba1-4cec-8ca6-9596986b9fcd service placement] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:30.420990 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:30.421621 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:30.422070 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:30.422335 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] PATH_INFO: `/v3/users/3051fcf3dc974d0f85fa33da0fbbd0a6` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:30.423845 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3051fcf3dc974d0f85fa33da0fbbd0a6)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:30.426096 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:30.486955 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3051fcf3dc974d0f85fa33da0fbbd0a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.487851 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3051fcf3dc974d0f85fa33da0fbbd0a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.501183 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3051fcf3dc974d0f85fa33da0fbbd0a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.508893 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3051fcf3dc974d0f85fa33da0fbbd0a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.509653 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3051fcf3dc974d0f85fa33da0fbbd0a6'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.525454 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1512/3027] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:49:30 2022] DELETE /identity/v3/users/3051fcf3dc974d0f85fa33da0fbbd0a6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:49:30.715556 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:30.726908 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a98ccc-26e1-498a-a949-5a1752c7304a service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:30.792535 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:30.793141 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:30.793410 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:30.793697 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] PATH_INFO: `/v3/projects/de7948fb58dd4ac6a7f25f174896c37e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:30.795018 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7948fb58dd4ac6a7f25f174896c37e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:30.796947 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:30.846189 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7948fb58dd4ac6a7f25f174896c37e', 'request_id': 'req-44844435-fdbb-46e5-8451-acd333bea392'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.852166 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7948fb58dd4ac6a7f25f174896c37e', 'request_id': 'req-44844435-fdbb-46e5-8451-acd333bea392'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.857975 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7948fb58dd4ac6a7f25f174896c37e', 'request_id': 'req-44844435-fdbb-46e5-8451-acd333bea392'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.871689 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] The token cache is being invalidate because project de7948fb58dd4ac6a7f25f174896c37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:49:30.871965 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.872570 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:30.874118 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1516/3028] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:49:30 2022] DELETE /identity/v3/projects/de7948fb58dd4ac6a7f25f174896c37e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:49:30.878247 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:30.879861 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:30.893074 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30814-10f7-498e-ac2b-a8d10844369d admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:30.954436 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:30.954991 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:30.955261 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:30.955526 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] PATH_INFO: `/v3/users/29394cd123de4abb9e3e0b5cbf555510` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:30.956665 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29394cd123de4abb9e3e0b5cbf555510)` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:30.958826 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:31.009649 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29394cd123de4abb9e3e0b5cbf555510'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.010329 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29394cd123de4abb9e3e0b5cbf555510'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.021112 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:49:31.022412 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29394cd123de4abb9e3e0b5cbf555510'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.031220 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29394cd123de4abb9e3e0b5cbf555510'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.031957 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.notifications [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29394cd123de4abb9e3e0b5cbf555510'} {{(pid=81731) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.045293 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1513/3029] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 30 10:49:30 2022] DELETE /identity/v3/users/29394cd123de4abb9e3e0b5cbf555510 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:49:31.221550 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:31.223173 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:31.243208 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844435-fdbb-46e5-8451-acd333bea392 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:31.289113 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:49:31.309479 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3875a2ed124d19b88d1590553ab6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebff7cf09dfd4e619d4653fe8d95360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:31.310143 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:31.310403 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:31.310680 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] PATH_INFO: `/v3/projects/17f946567d1345d5acd90df5fe835275` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:31.311816 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f946567d1345d5acd90df5fe835275)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:31.313849 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:31.361829 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f946567d1345d5acd90df5fe835275', 'request_id': 'req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.368314 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f946567d1345d5acd90df5fe835275', 'request_id': 'req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.374579 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f946567d1345d5acd90df5fe835275', 'request_id': 'req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.388921 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] The token cache is being invalidate because project 17f946567d1345d5acd90df5fe835275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:49:31.389202 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.389860 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2cfc3c23-8991-4baf-8cb6-b0b4e16591f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:49:31.391360 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1517/3030] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 30 10:49:31 2022] DELETE /identity/v3/projects/17f946567d1345d5acd90df5fe835275 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:49:41.041890 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:49:41.386288 dv-neutron-master-2-hyperv devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:51:58.887477 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Authenticating user token {{(pid=81731) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:51:58.889237 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:51:58.976223 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10306-c779-4a9c-81c2-fdb1addfc51a admin admin] Validating token access rules against request {{(pid=81731) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:51:59.043798 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4a112-47b1-40d1-9f21-4b2bd1b0911a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7777f87a39a47999af1bfda0b3883d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb57050b93a6408e991b5898992d6de9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81731) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:51:59.044413 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a112-47b1-40d1-9f21-4b2bd1b0911a service placement] REQUEST_METHOD: `GET` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:51:59.044669 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a112-47b1-40d1-9f21-4b2bd1b0911a service placement] SCRIPT_NAME: `/identity` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:51:59.044938 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a112-47b1-40d1-9f21-4b2bd1b0911a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81731) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:51:59.046944 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.fernet_utils [None req-b4b4a112-47b1-40d1-9f21-4b2bd1b0911a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81731) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:51:59.058042 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4a112-47b1-40d1-9f21-4b2bd1b0911a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:51:59.059618 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4a112-47b1-40d1-9f21-4b2bd1b0911a service placement] RBAC: Authorization granted {{(pid=81731) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:51:59.069199 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: [pid: 81731|app: 0|req: 1514/3031] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 30 10:51:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:52:09.065394 dv-neutron-master-2-hyperv devstack@keystone.service[81731]: DEBUG dbcounter [-] [81731] Writing DB stats keystone:SELECT=58 {{(pid=81731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}